-- Logs begin at Fri 2022-08-05 01:08:59 UTC, end at Fri 2022-08-05 02:46:20 UTC. -- Aug 05 02:11:45.872769 dv-cinder-815582-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 02:11:45.881393 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 02:11:45.883850 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 02:11:45 2022] *** Aug 05 02:11:45.883850 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 02:11:45.883850 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 02:11:45.883850 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: nodename: dv-cinder-815582-13-iscsi Aug 05 02:11:45.883850 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: machine: x86_64 Aug 05 02:11:45.883850 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: clock source: unix Aug 05 02:11:45.883850 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: pcre jit disabled Aug 05 02:11:45.883850 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: detected number of CPU cores: 4 Aug 05 02:11:45.883850 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: current working directory: / Aug 05 02:11:45.883850 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: detected binary path: /usr/bin/uwsgi-core Aug 05 02:11:45.884583 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: your processes number limit is 47680 Aug 05 02:11:45.884583 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: your memory page size is 4096 bytes Aug 05 02:11:45.884583 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: detected max file descriptor number: 2048 Aug 05 02:11:45.884583 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: lock engine: pthread robust mutexes Aug 05 02:11:45.884583 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: thunder lock: enabled Aug 05 02:11:45.884583 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 02:11:45.884583 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 02:11:45.924073 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: Python main interpreter initialized at 0x55ca7efb09c0 Aug 05 02:11:45.924073 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: python threads support enabled Aug 05 02:11:45.924073 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: your server socket listen backlog is limited to 100 connections Aug 05 02:11:45.924073 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: your mercy for graceful operations on workers is 90 seconds Aug 05 02:11:45.924441 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 02:11:45.924515 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: *** Operational MODE: preforking *** Aug 05 02:11:45.924772 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: *** uWSGI is running in multiple interpreter mode *** Aug 05 02:11:45.924772 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: spawned uWSGI master process (pid: 103408) Aug 05 02:11:45.924968 dv-cinder-815582-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 02:11:45.927317 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: spawned uWSGI worker 1 (pid: 103409, cores: 1) Aug 05 02:11:45.927317 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: spawned uWSGI worker 2 (pid: 103410, cores: 1) Aug 05 02:11:45.927317 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 02:11:46.582870 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 02:11:46.584547 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 02:11:47.659198 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 02:11:47.659198 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: from cryptography.utils import int_from_bytes Aug 05 02:11:47.659795 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 02:11:47.659795 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: from cryptography.utils import int_from_bytes Aug 05 02:11:47.667411 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 02:11:47.667411 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: from cryptography.utils import int_from_bytes Aug 05 02:11:47.667892 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 02:11:47.667892 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: from cryptography.utils import int_from_bytes Aug 05 02:11:50.139089 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 02:11:50.139627 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 02:11:50.139726 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 02:11:50.140085 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 02:11:50.140180 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 02:11:50.140263 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 02:11:50.140379 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 02:11:50.140506 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 02:11:50.140733 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.140851 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 02:11:50.141053 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.141150 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 02:11:50.141371 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.141459 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.141687 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.141811 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.142011 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.142109 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.142315 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.142410 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.142629 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.142726 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.142940 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.143036 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.143259 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.143355 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.143514 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.143596 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.143821 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.143916 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.144139 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.144240 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-13-iscsi {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.144475 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.144565 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.144775 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.144872 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-13-iscsi {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.145078 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.145176 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.145387 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.145473 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.145685 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.145790 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.145995 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.146141 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.146296 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.146391 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.146610 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.146780 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.146914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.147209 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.147415 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.147525 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.147727 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.147836 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.148029 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.148124 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.148349 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.148468 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.149353 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.149468 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.149616 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.149757 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.149911 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.150107 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.150202 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.150575 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.150688 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.150767 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.150966 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-13-iscsi {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.151076 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.151277 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.151371 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.151584 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.151743 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-13-iscsi {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.151896 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.152034 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.152296 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.152398 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.152693 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.152852 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.152997 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.153121 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.153310 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.153432 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.153628 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.153729 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.153934 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.154046 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.154252 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.154364 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.154565 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.154660 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.154879 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.154978 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.155193 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.155282 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.155488 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.155575 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.155789 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.155883 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.156102 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.156191 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.156436 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.156572 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.156739 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.156850 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.157038 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.157126 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.157286 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.157386 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.157588 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.157685 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.157899 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.157994 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.158203 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.158292 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.158517 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.158659 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.158790 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.158914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.159000 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.159139 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.159300 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.159388 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.159614 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.159713 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.159916 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.160014 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.160219 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.160305 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.160549 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.160648 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.160853 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.160949 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.161151 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.161236 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.161452 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.161548 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.161748 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.161863 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.162048 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.162138 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.162351 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.162445 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.162654 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.162743 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.162966 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.163057 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.163266 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.163362 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.163580 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.163668 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.163885 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.163975 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.164227 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.164319 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.164596 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.164863 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.164956 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.165036 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.165180 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.165268 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.165515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.165605 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.165824 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.165908 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.166127 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.166271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.166431 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.166516 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.166732 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.166820 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.167030 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.167127 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.167331 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.167418 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.167634 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.167720 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.167937 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.168032 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.168183 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.168273 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.168505 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.168641 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.168806 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.168906 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.169100 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.169186 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.169401 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.169485 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.169700 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.169797 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.169999 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.170087 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.170294 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.170381 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.170593 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.170680 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.170887 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.170972 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.171184 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.171268 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.171480 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.171576 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.171777 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.171862 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.172072 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.172158 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.172390 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.172482 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.172689 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.172784 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.172986 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.173072 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.173287 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.173384 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.173587 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.173681 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.173884 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.173982 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.174183 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.174269 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.174481 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.174576 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.174779 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.174864 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.175081 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.175177 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.175375 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.175462 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.175673 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.175759 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.175972 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.176058 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.176275 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.176424 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.176599 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.176697 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.176902 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.176999 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.177198 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.177300 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.177496 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.177600 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.177794 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.177888 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.178084 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.178180 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.178385 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.178495 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.178680 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.178775 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.178979 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.179074 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.179273 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.179376 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.179568 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.179663 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.179917 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.180524 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.180621 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.180716 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.180798 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.180884 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.180971 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.181051 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.181147 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.181240 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.181387 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.181498 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.181688 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.181775 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.181983 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.182071 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.182297 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.182395 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.182607 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.182693 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.182906 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.182992 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.183207 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.183292 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.183507 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.183593 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.183821 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:11:50.183909 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.184151 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.184288 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.184485 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.184582 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.184815 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.184902 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.185149 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.185246 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.185440 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.185538 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.185746 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.185832 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.186061 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.186155 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.186371 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.186488 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.186673 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.186774 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.186982 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.187085 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.187286 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.187374 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.187593 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.187677 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.187902 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.187985 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.188214 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.188337 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.188556 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.188645 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.188866 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.188950 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.189179 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.189268 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.189485 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.189572 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.189796 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.189884 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.190100 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.190186 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.190413 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.190499 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.190714 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.190799 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.191044 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.191138 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.191350 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.191445 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.191670 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.191755 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.191990 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.192079 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.192304 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.192410 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.192634 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.192802 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.192941 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.193029 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.193246 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.193331 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.193550 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.193645 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.193859 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.193945 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.194166 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.194250 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.194478 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.194581 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.194783 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.194880 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.195087 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.195174 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.195390 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.195995 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.196269 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.196660 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.196660 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.196807 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.196899 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.196970 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.197154 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.197245 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.197476 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.197560 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.197780 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.197867 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.198090 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.198174 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.198393 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.198477 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.198698 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.198793 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.199003 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.199144 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.199303 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.199448 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.199592 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.199737 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.199872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.200025 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.200161 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.200295 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.200475 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.200618 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.200791 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.200934 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.201076 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.201216 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.201392 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.201529 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.201714 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.201848 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.202016 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.202160 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.202323 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.202456 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.202629 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.202762 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.202930 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.203078 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.203232 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.203367 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.203536 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.203670 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.203837 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.203989 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.204123 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.204258 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.204458 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.204591 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.204762 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.204893 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.205061 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.205190 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.205378 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.205511 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.205677 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.205807 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.205960 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.206094 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.206268 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.206399 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.206577 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.206710 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.206879 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.207017 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.207187 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.207275 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.207491 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.207577 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.207795 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.207881 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.208102 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.208194 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.208434 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.208537 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.208752 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.208846 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.209064 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.209159 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.209367 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.209453 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.209686 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.209772 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.210004 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.210097 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.210315 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.210403 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.210616 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.210710 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.210920 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.211015 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.211876 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.212020 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.212152 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.212473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.212587 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.212779 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.212866 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.213081 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.213169 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.213382 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.213476 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.213682 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.213775 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.213984 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.214344 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.214558 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.214662 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.214857 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.214943 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.215157 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.215244 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.215467 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.215565 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.215767 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.215861 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.216067 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.216153 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.216388 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.216491 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.216693 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.216787 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.217018 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.217105 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.217326 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.217415 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.217664 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.217758 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.217974 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.218058 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.218292 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.218387 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.218599 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.218685 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.218905 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.218990 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.219209 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.219295 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.219513 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.219598 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.219818 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.219912 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.220124 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.220217 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.220461 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.220560 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.220771 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.220866 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.221077 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.221161 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.221378 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.221463 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.221687 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.221785 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.221986 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.222073 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.222301 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.222387 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.222597 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.222758 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.222907 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.222992 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.223220 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.223312 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.223550 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.223643 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.223860 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.223946 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.224174 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.224259 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.224511 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.224603 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.224819 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.224907 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.225121 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.225214 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.225425 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.225520 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.225726 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.225812 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.226031 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.226115 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.226340 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.226427 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.226641 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.226758 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.227042 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.227512 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.227616 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.227706 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.227785 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.227864 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.228042 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.228139 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.228367 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.228458 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.228690 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.228788 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.228992 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.229091 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.229306 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.229403 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.229629 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.229716 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.229937 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.230034 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.230243 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.230330 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.230548 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.230633 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.230849 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.230947 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.231154 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.231240 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.231455 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.231549 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.231752 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.231838 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.232049 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.232148 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.232369 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.232458 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.232680 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.232768 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.232983 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.233068 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.233285 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.233370 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.233581 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.233666 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.233879 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.233981 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.234177 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.234263 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.234475 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.234562 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.234771 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.235070 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.235164 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.235371 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.235456 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.235674 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.235765 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.235980 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.236079 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.236296 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.236457 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.236619 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.236703 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.236916 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.237028 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.237217 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.237303 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.237520 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.237616 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.237817 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.237912 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.238113 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.238201 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.238408 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.238493 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.238707 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.238846 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.239033 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.239119 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.239338 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.239431 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.239632 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.239718 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.239944 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.240037 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.240248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.240378 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.240580 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.240676 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.240885 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.240982 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.241189 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.241276 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.241493 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.241579 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.241798 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.241883 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.242102 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.242198 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.242443 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.243019 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.243116 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.243197 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.243275 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.243363 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.243443 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.243521 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.243631 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.243834 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.243922 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.244155 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.244244 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.244489 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.244579 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.244801 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.244937 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.245111 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.245200 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.245415 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.245509 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.245724 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.245973 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.246069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.246314 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.246584 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.246671 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.246914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.247007 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.247227 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.247313 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.247541 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.247626 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.247854 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.247946 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.248169 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.248256 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.248523 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.248615 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.248827 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.248922 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.249137 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.249226 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.249440 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.249540 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.249740 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.249825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.250045 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.250140 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.250346 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.250441 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.250646 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.250732 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.250945 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.251041 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.251244 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.251329 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.251538 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.251622 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.251837 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.251934 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.252134 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.252220 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.252454 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.252543 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.252760 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.252858 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.253057 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.253141 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.253361 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.253447 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.253657 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.253751 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.253960 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.254046 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.254258 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.254350 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.254555 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.254649 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.254854 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.254940 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.255151 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.255255 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.255446 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.255532 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.255746 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.255831 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.256083 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.256170 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.256414 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.256504 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.256753 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.256839 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.257056 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.257151 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.257354 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.257447 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.257670 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.257756 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.258497 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.259132 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.259230 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.259318 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.259398 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.259484 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.259611 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.259709 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.259790 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.259868 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.259945 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.260091 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.260224 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.260427 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.260552 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.260732 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.260855 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.261042 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.261158 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.261348 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.261442 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.261658 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.261745 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.261965 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.262059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.262266 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.262353 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.262574 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.262659 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.262876 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.262971 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.263167 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.263252 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.263469 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.263555 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.263769 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.263868 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.264065 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.264155 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.264386 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.264486 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.264688 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.264776 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.264985 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.265119 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.265281 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.265367 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.265579 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.265666 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.265874 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.265960 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.266172 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.266257 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.266470 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.266556 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.266765 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.266849 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.267070 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.267156 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.267369 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.267463 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.267666 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.267750 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.267958 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.268050 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.268258 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.268407 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.268582 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.268671 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.268879 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.268976 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.269177 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.269265 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.269473 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.269559 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.269773 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.269879 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.270067 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.270152 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.270370 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.270455 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.270667 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.270762 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.270964 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.271050 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.271260 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.271346 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.271555 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.271642 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.271849 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.271934 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.272146 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.272230 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.272468 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.272557 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.272766 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.272862 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.273061 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.273154 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.273358 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.273451 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.273742 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.274177 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.274263 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.274350 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.274350 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.274512 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.274632 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.274720 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.274933 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.275097 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.275227 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.275315 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.275519 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.275615 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.275856 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.275954 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.276159 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.276246 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.276494 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.276583 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.276807 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.276908 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.277112 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.277199 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.277422 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.277508 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.277722 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.277876 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.278026 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.278119 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.278328 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.278413 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.278626 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.278712 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.278924 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.279009 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.279223 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.279319 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.279532 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.279654 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.279833 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.279954 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.280138 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.280223 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.280477 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.280571 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.280800 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.280886 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.281120 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.281206 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.281422 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.281510 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.281727 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.281813 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.282032 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.282128 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.282336 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.282429 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.282640 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.282726 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.282942 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.283034 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.283243 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.283336 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.283546 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.283631 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.283848 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.283940 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.284152 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.284236 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.284480 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.284566 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.284784 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.284881 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.285091 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.285175 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.285393 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.285499 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.285692 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.285780 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.285995 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.286081 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.286302 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.286398 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.286601 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.286687 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.286910 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.286998 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.287212 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.287298 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.287511 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.287597 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.287807 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.287930 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.288107 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.288223 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.288439 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.288558 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.288741 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.288863 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.289165 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.289818 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.290341 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.290427 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.290506 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.290598 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.290686 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.290776 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.290856 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.290987 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.291155 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.291251 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.291480 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.291575 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.291792 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.291887 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.292096 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.292182 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.292466 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.292568 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.292772 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.292860 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.293072 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.293159 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.293375 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.293471 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.293696 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.293783 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.293995 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.294087 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.294290 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.294383 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.294589 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.294676 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.294901 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.294989 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.295199 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.295284 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.295496 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.295588 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.295819 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.295906 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.296123 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.296211 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.296466 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.296572 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.296881 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.296978 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.297192 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.297285 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.297493 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.297587 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.297809 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.297904 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.298130 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.298226 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.298449 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.298535 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.298753 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.298852 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.299065 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.299152 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.299371 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.299468 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.299688 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.299775 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.300000 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.300155 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.300303 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.300401 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.300639 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.300728 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.300939 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.301036 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.301258 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.301345 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.301569 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.301663 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.301875 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.301970 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.302191 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.302278 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.302508 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.302593 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.302823 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.302912 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.303144 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.303239 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.303485 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.303571 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.303806 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.303902 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.304107 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.304195 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.304438 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.304530 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.304745 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.304984 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.305438 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.305523 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.305523 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.305656 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.305765 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.305853 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.306068 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.306155 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.306371 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.306466 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.306694 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.306783 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.306997 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.307084 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.307308 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.307403 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.307605 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.307691 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.307909 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.307995 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.308207 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.308316 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.308531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.308618 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.308843 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.308928 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.309142 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.309237 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.309461 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.309556 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.309759 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.309846 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.310076 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.310170 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.310386 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.310481 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.310676 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.310763 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.310974 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.311071 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.311272 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.311358 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.311569 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.311655 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.311870 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.311967 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.312171 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.312272 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.312529 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.312631 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.312828 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.312922 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.313144 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.313230 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.313465 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.313559 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.313780 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.313866 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.314085 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.314179 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.314394 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.314525 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.314713 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.314802 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.315011 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.315100 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.315310 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.315406 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.315614 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.315744 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.315912 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.316007 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.316209 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.316310 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.316534 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.316623 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.316832 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.316918 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.317125 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.317212 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.317422 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.317507 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.317717 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.317803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.318013 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.318100 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.318314 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.318412 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.318613 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.318700 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.318915 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.319003 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.319210 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.319297 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.319506 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.319608 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.319802 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.319890 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.320101 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.320196 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.320947 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.321444 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.321543 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.321626 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.321704 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.321784 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.321862 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.322016 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.322176 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.322273 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.322484 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.322584 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.322803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.322906 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.323115 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.323203 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.323426 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.323513 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.323731 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.323818 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.324041 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.324130 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.324362 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.324452 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.324679 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.324777 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.324986 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.325073 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.325293 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.325378 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.325599 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.325796 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.325909 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.326115 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.326227 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.326423 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.326730 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.326824 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.327036 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.327123 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.327340 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.327434 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.327645 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.327731 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.327945 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.328030 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.328249 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.328468 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.328567 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.328649 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.328871 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.328968 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.329176 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.329335 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.329482 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.329578 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.329788 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.329877 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.330110 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.330195 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.330422 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.330518 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.330730 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.330818 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.331037 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.331126 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.331344 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.331441 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.331653 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.331739 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.331964 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.332053 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.332267 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.332372 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.332603 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.332702 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.332912 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.332999 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.333220 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.333307 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.333526 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.333616 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.333857 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.333965 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.334130 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.334218 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.334435 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.334531 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.334737 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.334824 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.335041 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.335128 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.335348 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.335437 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.335655 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.335741 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.335968 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.336080 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.336670 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.336763 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.336845 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.336925 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.337004 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.337092 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.337287 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.337376 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.337597 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.337687 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.337941 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.338112 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.338254 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.338421 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.338568 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.338746 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.339343 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.339444 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.339660 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.339751 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.339967 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.340054 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.340276 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.340384 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.340633 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.340729 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.340930 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.341024 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.341226 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.341316 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.341531 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.341620 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.341833 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.341925 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.342128 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.342224 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.342434 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.342532 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.342734 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.342819 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.343030 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.343118 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.343340 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.343426 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.343642 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.343741 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.343940 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.344163 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.344250 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.344526 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.344616 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.344837 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.345087 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.345183 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.345426 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.345514 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.345740 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.345837 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.346041 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.346127 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.346360 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.346446 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.346661 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.346756 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.346960 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.347047 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.347272 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.347358 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.347573 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.347709 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.347875 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.347974 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.348175 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.348263 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.348508 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.348606 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.348809 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.348903 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.349106 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.349192 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.349411 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.349498 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.349704 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.349789 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.350001 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.350086 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.350309 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.350396 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.350604 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.350690 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.350901 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.350995 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.351204 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.351298 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.351501 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.351588 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.352579 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.352975 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.353061 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.353141 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.353141 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.353286 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.353363 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.353450 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.353645 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.353735 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.353951 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.354090 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.354264 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.354367 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.354567 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.354654 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.354864 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.354949 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.355165 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.355259 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.355463 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.355549 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.355763 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.355849 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.356067 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.356150 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.356395 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.356498 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.356725 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.356814 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.357029 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.357115 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.357347 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.357441 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.357655 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.357791 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.357961 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.358053 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.358278 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.358376 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.358590 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.358756 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.358899 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.359112 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.359243 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.359443 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.359557 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.359761 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.360087 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.360174 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.360437 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.360526 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.360745 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.360850 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.361048 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.361134 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.361349 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.361446 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.361668 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.361768 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.361969 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.362064 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.362272 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.362367 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.362576 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.362664 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.362882 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.362969 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.363186 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.363273 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.363488 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.363575 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.363791 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.363877 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.364092 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.364177 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.364420 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.364529 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.364727 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.364815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.365029 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.365129 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.365328 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.365414 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.365631 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.365716 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.365932 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.366027 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.366236 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.366322 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.366548 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.366642 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.366853 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.366958 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.367160 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.367245 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.367597 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.367714 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.367921 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.368018 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.368237 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.368341 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.368576 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.368677 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.368882 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.368980 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.369187 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.369284 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.369490 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.369576 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.369798 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.369895 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.370104 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.370192 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.370403 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.370497 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.370727 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.370858 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.371039 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.371127 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.371342 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.371438 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.371702 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.371787 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.372005 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.372093 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.372350 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.372455 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.372661 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.372764 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.372966 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.373054 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.373280 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.373370 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.373584 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.373671 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.373887 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.373986 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.374206 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.374294 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.374516 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.374604 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.374832 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.374918 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.375132 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.375220 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.375432 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.375519 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.375730 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.375825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.376035 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.376131 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.376365 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.376456 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.376674 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.376772 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.376968 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.377054 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.377263 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.377351 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.377564 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.377661 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.377861 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.377955 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.378154 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.378253 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.378454 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.378551 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.378751 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.378875 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.379050 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.379143 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.379345 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.379432 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.379640 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.379726 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.379935 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.380022 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.380229 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.380316 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.380550 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.380645 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.380911 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.381019 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.381144 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.381234 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.381438 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.381523 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.381735 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.381823 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.382028 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.382115 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.382326 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.382412 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.382617 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.382716 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.382939 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.383536 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.384106 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.384212 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.384284 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.384397 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.384471 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.384643 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.384731 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.384950 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.385039 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.385267 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.385356 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.385574 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.385672 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.385891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.385978 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.386195 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.386291 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.386502 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.386596 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.386807 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.386908 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.387114 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.387207 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.387421 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.387509 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.387723 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.387884 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.388028 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.388166 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.388362 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.388454 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.388657 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.388760 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.388961 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.389047 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.389311 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.389405 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.389574 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.389671 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.389874 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.389960 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.390193 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.390280 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.390493 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.390580 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.390802 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.390887 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.391112 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.391214 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.391412 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.391502 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.391720 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.391814 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.392019 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.392107 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.392337 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.392429 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.392646 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.392746 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.392948 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.393050 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.393250 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.393338 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.393555 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.393648 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.393856 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.393950 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.394156 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.394243 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.394457 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.394543 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.394760 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.394853 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.395067 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.395161 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.395377 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.395465 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.395675 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.395762 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.395993 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.396088 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.396295 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.396471 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.396656 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.396748 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.396958 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.397044 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.397290 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.397385 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.397595 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.397683 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.397900 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.397992 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.398204 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.398302 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.398504 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.398633 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.399108 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 02:11:50.399200 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.399356 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:11:50.399603 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 02:11:50.552722 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO dbcounter [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] Registered counter for database nova_api Aug 05 02:11:50.553078 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO dbcounter [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] Registered counter for database nova_api Aug 05 02:11:50.572993 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG oslo_db.sqlalchemy.engines [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:11:50.575953 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_db.sqlalchemy.engines [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:11:50.579616 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG dbcounter [-] [103410] Writer thread running {{(pid=103410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:11:50.582446 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writer thread running {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:11:50.638025 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.context [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6a4fb03c-ecbf-4928-85f2-a2fa83e41a91(cell1) {{(pid=103410) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 02:11:50.638210 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.context [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6a4fb03c-ecbf-4928-85f2-a2fa83e41a91(cell1) {{(pid=103409) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 02:11:50.641970 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG oslo_concurrency.lockutils [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:11:50.642133 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:11:50.642368 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG oslo_concurrency.lockutils [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:11:50.642527 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:11:50.643907 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:11:50.644013 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG oslo_concurrency.lockutils [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:11:50.644660 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:11:50.644767 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG oslo_concurrency.lockutils [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:11:50.645105 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:11:50.645203 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG oslo_concurrency.lockutils [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:11:50.647053 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:11:50.647155 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG oslo_concurrency.lockutils [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:11:50.649551 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO dbcounter [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] Registered counter for database nova_cell0 Aug 05 02:11:50.650037 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO dbcounter [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] Registered counter for database nova_cell0 Aug 05 02:11:50.655403 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO dbcounter [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] Registered counter for database nova_cell1 Aug 05 02:11:50.655518 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO dbcounter [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] Registered counter for database nova_cell1 Aug 05 02:11:50.663096 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_db.sqlalchemy.engines [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:11:50.667209 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG oslo_db.sqlalchemy.engines [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:11:50.668560 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_db.sqlalchemy.engines [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:11:50.670271 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG oslo_db.sqlalchemy.engines [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:11:50.672988 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writer thread running {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:11:50.674504 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG dbcounter [-] [103410] Writer thread running {{(pid=103410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:11:50.809343 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writer thread running {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:11:50.814629 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG dbcounter [-] [103410] Writer thread running {{(pid=103410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:11:50.819175 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO dbcounter [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] Registered counter for database nova_cell0 Aug 05 02:11:50.824479 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO dbcounter [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] Registered counter for database nova_cell0 Aug 05 02:11:50.826468 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_db.sqlalchemy.engines [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:11:50.831383 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writer thread running {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:11:50.833534 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG oslo_db.sqlalchemy.engines [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:11:50.839370 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG dbcounter [-] [103410] Writer thread running {{(pid=103410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:11:51.168605 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: WARNING keystonemiddleware.auth_token [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 02:11:51.170570 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: WARNING keystonemiddleware.auth_token [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 02:11:51.175721 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: WARNING keystonemiddleware.auth_token [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 02:11:51.177789 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: WARNING keystonemiddleware.auth_token [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 02:11:51.517281 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: WARNING keystonemiddleware.auth_token [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 02:11:51.520881 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: WARNING keystonemiddleware.auth_token [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 02:11:51.523153 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: WARNING keystonemiddleware.auth_token [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 02:11:51.527762 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: WARNING keystonemiddleware.auth_token [None req-6f1bd34c-fe8d-4a81-8dcd-312a678f2f53 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 02:11:51.528864 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ca7efb09c0 pid: 103409 (default app) Aug 05 02:11:51.530924 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:11:51.532101 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001727 Aug 05 02:11:51.532546 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Fri Aug 5 02:11:51 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:11:51.533017 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ca7efb09c0 pid: 103410 (default app) Aug 05 02:13:06.305518 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:06.306523 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 05 02:13:06.306918 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Fri Aug 5 02:13:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:13:06.319815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG dbcounter [-] [103410] Writing DB stats nova_api:SELECT=3 {{(pid=103410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:06.320766 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG dbcounter [-] [103410] Writing DB stats nova_cell1:SELECT=3 {{(pid=103410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:06.321929 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG dbcounter [-] [103410] Writing DB stats nova_cell0:SELECT=3 {{(pid=103410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:06.323106 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG dbcounter [-] [103410] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:07.206832 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-e955a3c9-a4ab-4367-946e-9a37cc09360e admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:07.242342 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-e955a3c9-a4ab-4367-946e-9a37cc09360e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.927646 Aug 05 02:13:07.243229 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Fri Aug 5 02:13:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:13:09.447840 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:09.450751 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-3c17c76e-0b1f-4d7c-b3cb-a2516359569c None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003309 Aug 05 02:13:09.451320 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Fri Aug 5 02:13:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:13:09.910551 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-dfaef5b9-3db7-4a39-a71b-5fbe9d1bcb41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:09.931582 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:13:09.931582 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: warnings.warn(msg) Aug 05 02:13:09.960339 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-dfaef5b9-3db7-4a39-a71b-5fbe9d1bcb41 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.502862 Aug 05 02:13:09.969048 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Aug 5 02:13:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:13:10.188191 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-bc7f61b7-34e6-4136-8f25-065da1450fd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:10.192517 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:13:10.192517 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: warnings.warn(msg) Aug 05 02:13:10.208565 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_api:SELECT=3 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:10.209313 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_cell0:SELECT=3 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:10.209778 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_cell1:SELECT=3 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:10.210514 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:10.257122 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-bc7f61b7-34e6-4136-8f25-065da1450fd3 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286630 Aug 05 02:13:10.266439 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Fri Aug 5 02:13:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:13:12.512008 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-dfaef5b9-3db7-4a39-a71b-5fbe9d1bcb41 admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:12.513135 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-dfaef5b9-3db7-4a39-a71b-5fbe9d1bcb41 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002109 Aug 05 02:13:12.513728 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Fri Aug 5 02:13:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:13:13.176803 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-2812111d-bae7-47e8-b1fd-2bdda2e699c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "vcpus": 1, "swap": 0, "id": "d1", "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:13.201544 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:13:13.201544 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: warnings.warn(msg) Aug 05 02:13:13.226720 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-2812111d-bae7-47e8-b1fd-2bdda2e699c6 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.706935 Aug 05 02:13:13.227940 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Aug 5 02:13:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 02:13:13.240134 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-cb906681-aef5-4c29-b9e1-432c860e062b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:13.242951 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:13:13.242951 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: warnings.warn(msg) Aug 05 02:13:13.276250 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-cb906681-aef5-4c29-b9e1-432c860e062b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039799 Aug 05 02:13:13.277097 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Fri Aug 5 02:13:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:13:15.520573 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-2812111d-bae7-47e8-b1fd-2bdda2e699c6 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:15.521649 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-2812111d-bae7-47e8-b1fd-2bdda2e699c6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 05 02:13:15.528921 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Fri Aug 5 02:13:15 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:13:15.904438 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-f8440c0a-3e75-4657-89af-32782bbd1bc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "swap": 0, "disk": 10}} {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:15.923842 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-f8440c0a-3e75-4657-89af-32782bbd1bc0 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.395353 Aug 05 02:13:15.931358 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Aug 5 02:13:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:13:15.936438 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-9481b4a2-09fa-4d44-8132-6b44e9d38ce0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:15.960172 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-9481b4a2-09fa-4d44-8132-6b44e9d38ce0 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027557 Aug 05 02:13:15.960781 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Fri Aug 5 02:13:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:13:18.174956 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-f8440c0a-3e75-4657-89af-32782bbd1bc0 admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:18.176075 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-f8440c0a-3e75-4657-89af-32782bbd1bc0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Aug 05 02:13:18.177054 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Fri Aug 5 02:13:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:13:18.606791 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-a2a48645-a835-41a2-9d12-5afb32cd737b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "disk": 10, "vcpus": 2, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:18.626510 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-a2a48645-a835-41a2-9d12-5afb32cd737b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.443282 Aug 05 02:13:18.627174 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Aug 5 02:13:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:13:18.640025 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-aa1cef89-ec91-4210-99d2-81f0f41a8e83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:18.665526 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-aa1cef89-ec91-4210-99d2-81f0f41a8e83 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030161 Aug 05 02:13:18.666087 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Fri Aug 5 02:13:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:13:20.904707 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-a2a48645-a835-41a2-9d12-5afb32cd737b admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:20.905730 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-a2a48645-a835-41a2-9d12-5afb32cd737b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Aug 05 02:13:20.906344 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Fri Aug 5 02:13:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:13:21.341654 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-74aeb679-bdfe-4f3d-a2b3-47105e2025cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0}} {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:21.361871 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-74aeb679-bdfe-4f3d-a2b3-47105e2025cb admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449100 Aug 05 02:13:21.362760 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Aug 5 02:13:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 02:13:21.375166 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-7cf6157d-3c8b-465c-9da4-15409d0b0c31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:21.400708 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-7cf6157d-3c8b-465c-9da4-15409d0b0c31 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029902 Aug 05 02:13:21.401288 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Fri Aug 5 02:13:21 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:13:23.626888 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-74aeb679-bdfe-4f3d-a2b3-47105e2025cb admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:23.628237 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-74aeb679-bdfe-4f3d-a2b3-47105e2025cb admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001952 Aug 05 02:13:23.628827 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Fri Aug 5 02:13:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:13:24.036157 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-0272612a-d747-4726-b341-1e65b5ba6e31 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:24.065748 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-0272612a-d747-4726-b341-1e65b5ba6e31 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.430828 Aug 05 02:13:24.066147 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Fri Aug 5 02:13:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:13:26.369668 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-74aeb679-bdfe-4f3d-a2b3-47105e2025cb admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:26.370754 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-74aeb679-bdfe-4f3d-a2b3-47105e2025cb admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 05 02:13:26.371831 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Fri Aug 5 02:13:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:13:26.785271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-198e46e6-0dcd-4bfc-b004-559cd103cd53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "id": "1", "os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1, "disk": 1, "rxtx_factor": 1.0}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:26.810077 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-198e46e6-0dcd-4bfc-b004-559cd103cd53 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.431915 Aug 05 02:13:26.810781 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Aug 5 02:13:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:13:26.823357 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-17bc07aa-663d-4e75-a9aa-f419476ee691 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:26.849916 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-17bc07aa-663d-4e75-a9aa-f419476ee691 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030240 Aug 05 02:13:26.855846 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Fri Aug 5 02:13:26 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:13:29.302824 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-198e46e6-0dcd-4bfc-b004-559cd103cd53 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:29.303832 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-198e46e6-0dcd-4bfc-b004-559cd103cd53 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 05 02:13:29.304229 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Fri Aug 5 02:13:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:13:29.703361 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-cbe3786d-1fe4-47ad-81a4-6642bf472d7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:29.722136 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-cbe3786d-1fe4-47ad-81a4-6642bf472d7e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.411857 Aug 05 02:13:29.722613 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Aug 5 02:13:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 02:13:29.734995 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-d32a9f22-1794-4687-98af-079f47022057 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:29.758835 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-d32a9f22-1794-4687-98af-079f47022057 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028122 Aug 05 02:13:29.759620 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Fri Aug 5 02:13:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:13:31.945751 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-cbe3786d-1fe4-47ad-81a4-6642bf472d7e admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:31.946706 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-cbe3786d-1fe4-47ad-81a4-6642bf472d7e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 05 02:13:31.948650 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Fri Aug 5 02:13:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:13:32.327959 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-77365a43-799a-4cab-86dc-34eec1730c3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "name": "m1.medium"}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:32.349289 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-77365a43-799a-4cab-86dc-34eec1730c3e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.395707 Aug 05 02:13:32.349850 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Aug 5 02:13:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 02:13:32.361592 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-5a30025e-3d86-42e1-8f45-70f4dd130f32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:32.386449 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-5a30025e-3d86-42e1-8f45-70f4dd130f32 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028480 Aug 05 02:13:32.387320 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Fri Aug 5 02:13:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:13:34.634292 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-77365a43-799a-4cab-86dc-34eec1730c3e admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:34.635379 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-77365a43-799a-4cab-86dc-34eec1730c3e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Aug 05 02:13:34.636029 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Fri Aug 5 02:13:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:13:35.096777 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-8cb8f21a-3da0-4469-900a-b8941b5ffdd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "name": "m1.large", "disk": 80, "id": "4", "ram": 8192}} {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:35.115570 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-8cb8f21a-3da0-4469-900a-b8941b5ffdd1 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.472778 Aug 05 02:13:35.120700 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Aug 5 02:13:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:13:35.128702 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-5a6b7248-7571-4887-8e0f-9fa250dc242d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:35.156694 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-5a6b7248-7571-4887-8e0f-9fa250dc242d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031536 Aug 05 02:13:35.157477 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Fri Aug 5 02:13:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:13:37.425266 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-8cb8f21a-3da0-4469-900a-b8941b5ffdd1 admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:37.426281 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-8cb8f21a-3da0-4469-900a-b8941b5ffdd1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 05 02:13:37.426684 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Fri Aug 5 02:13:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:13:37.870878 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-057fe9d7-33a8-4b4b-9552-5358489129fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "disk": 160, "swap": 0}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:37.895571 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-057fe9d7-33a8-4b4b-9552-5358489129fa admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.463139 Aug 05 02:13:37.896296 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Fri Aug 5 02:13:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:13:37.908795 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-26521348-5f01-4636-b585-3793ab979f84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:13:37.917197 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG dbcounter [-] [103410] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:37.938792 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-26521348-5f01-4636-b585-3793ab979f84 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033778 Aug 05 02:13:37.952356 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Fri Aug 5 02:13:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:13:58.332696 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-057fe9d7-33a8-4b4b-9552-5358489129fa admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:58.333717 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-057fe9d7-33a8-4b4b-9552-5358489129fa admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 05 02:13:58.334118 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Fri Aug 5 02:13:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:13:58.721930 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-bdb6f431-c028-4f7b-ab6d-29c478a42ac6 admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:58.743639 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-bdb6f431-c028-4f7b-ab6d-29c478a42ac6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403138 Aug 05 02:13:58.744563 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Fri Aug 5 02:13:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:13:59.806731 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-057fe9d7-33a8-4b4b-9552-5358489129fa admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:13:59.807738 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-057fe9d7-33a8-4b4b-9552-5358489129fa admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 05 02:13:59.808129 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Aug 5 02:13:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:14:00.339741 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-cbc3167b-f6be-4427-a7ac-25f00d35d637 admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:00.345329 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.wsgi [None req-cbc3167b-f6be-4427-a7ac-25f00d35d637 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-cbc3167b-f6be-4427-a7ac-25f00d35d637 admin admin] Request method failure captured: Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Accept: application/json Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Accept-Encoding: gzip, deflate Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Connection: keep-alive Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Content-Length: 0 Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Host: 10.222.0.15 Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Openstack-Api-Version: compute 2.90 Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Openstack-System-Scope: None Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: User-Agent: python-novaclient Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Auth-Token: gAAAAABi7HznoO2ygWg4RrccEEcFS_63f_FXIUbWxAYIFyurI5gs7ElIIHVX_AmxX8hSaQG5xrvJz8fSck4457BbU3b9d2Cj51TPbxCIOGPGa-xHug34Yig6f8Q73mCXUDvZ0CuKV7oGAUG9wUA-tHQ5goqWueHhaT92PoDz4WpEmGeAs9QA_74 Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Domain-Id: None Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Domain-Name: None Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Identity-Status: Confirmed Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Is-Admin-Project: True Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Project-Domain-Id: default Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Project-Domain-Name: Default Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Project-Id: a0be9d6a2aae470aa8143374d4c4992b Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Project-Name: admin Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Role: admin,reader,member Aug 05 02:14:00.348815 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Roles: admin,reader,member Aug 05 02:14:00.350410 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a0be9d6a2aae470aa8143374d4c4992b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a0be9d6a2aae470aa8143374d4c4992b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a0be9d6a2aae470aa8143374d4c4992b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a0be9d6a2aae470aa8143374d4c4992b"}]}] Aug 05 02:14:00.350410 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Tenant: admin Aug 05 02:14:00.350410 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Tenant-Id: a0be9d6a2aae470aa8143374d4c4992b Aug 05 02:14:00.350410 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Tenant-Name: admin Aug 05 02:14:00.350410 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-User: admin Aug 05 02:14:00.350410 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-User-Domain-Id: default Aug 05 02:14:00.350410 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-User-Domain-Name: Default Aug 05 02:14:00.350410 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-User-Id: c5c6e2a1691a410eaac17764c32341d7 Aug 05 02:14:00.350410 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-User-Name: admin Aug 05 02:14:00.350410 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: method: > Aug 05 02:14:00.350410 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: exception: Flavor 42 could not be found. Aug 05 02:14:00.350410 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: action_args: {'id': '42'} Aug 05 02:14:00.350410 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:14:00.350410 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:14:00.352515 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Aug 05 02:14:00.353914 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-cbc3167b-f6be-4427-a7ac-25f00d35d637 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:14:00.355164 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-cbc3167b-f6be-4427-a7ac-25f00d35d637 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.395715 Aug 05 02:14:00.355164 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Fri Aug 5 02:13:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:00.360809 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-602c75a3-76e9-492c-ae45-9af267b63eeb admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:00.364904 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:00.385448 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-602c75a3-76e9-492c-ae45-9af267b63eeb admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028316 Aug 05 02:14:00.385992 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Aug 5 02:14:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:14:00.395923 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-7ef6aa06-d029-42d0-98d7-9a03bfbd813c admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:00.420279 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-7ef6aa06-d029-42d0-98d7-9a03bfbd813c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028005 Aug 05 02:14:00.420828 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Aug 5 02:14:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:14:00.430882 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-2c56117b-de5c-4a52-9bad-ca2fa6c2c0cf admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:00.438031 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.wsgi [None req-2c56117b-de5c-4a52-9bad-ca2fa6c2c0cf admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-2c56117b-de5c-4a52-9bad-ca2fa6c2c0cf admin admin] Request method failure captured: Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Accept: application/json Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Accept-Encoding: gzip, deflate Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Connection: keep-alive Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Content-Length: 0 Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Host: 10.222.0.15 Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Openstack-Api-Version: compute 2.90 Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Openstack-System-Scope: None Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: User-Agent: python-novaclient Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Auth-Token: gAAAAABi7HznoO2ygWg4RrccEEcFS_63f_FXIUbWxAYIFyurI5gs7ElIIHVX_AmxX8hSaQG5xrvJz8fSck4457BbU3b9d2Cj51TPbxCIOGPGa-xHug34Yig6f8Q73mCXUDvZ0CuKV7oGAUG9wUA-tHQ5goqWueHhaT92PoDz4WpEmGeAs9QA_74 Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Domain-Id: None Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Domain-Name: None Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Identity-Status: Confirmed Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Is-Admin-Project: True Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Project-Domain-Id: default Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Project-Domain-Name: Default Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Project-Id: a0be9d6a2aae470aa8143374d4c4992b Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Project-Name: admin Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Role: admin,reader,member Aug 05 02:14:00.441271 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Roles: admin,reader,member Aug 05 02:14:00.442779 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a0be9d6a2aae470aa8143374d4c4992b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a0be9d6a2aae470aa8143374d4c4992b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a0be9d6a2aae470aa8143374d4c4992b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a0be9d6a2aae470aa8143374d4c4992b"}]}] Aug 05 02:14:00.442779 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Tenant: admin Aug 05 02:14:00.442779 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Tenant-Id: a0be9d6a2aae470aa8143374d4c4992b Aug 05 02:14:00.442779 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Tenant-Name: admin Aug 05 02:14:00.442779 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-User: admin Aug 05 02:14:00.442779 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-User-Domain-Id: default Aug 05 02:14:00.442779 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-User-Domain-Name: Default Aug 05 02:14:00.442779 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-User-Id: c5c6e2a1691a410eaac17764c32341d7 Aug 05 02:14:00.442779 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-User-Name: admin Aug 05 02:14:00.442779 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: method: > Aug 05 02:14:00.442779 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: exception: Flavor 42 could not be found. Aug 05 02:14:00.442779 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: action_args: {'id': '42'} Aug 05 02:14:00.442779 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:14:00.442779 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:14:00.443872 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Aug 05 02:14:00.445197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-2c56117b-de5c-4a52-9bad-ca2fa6c2c0cf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:14:00.446438 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-2c56117b-de5c-4a52-9bad-ca2fa6c2c0cf admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016130 Aug 05 02:14:00.446438 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Fri Aug 5 02:14:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:01.406426 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-7ef6aa06-d029-42d0-98d7-9a03bfbd813c admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:01.407444 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-7ef6aa06-d029-42d0-98d7-9a03bfbd813c admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 05 02:14:01.407842 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Aug 5 02:14:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:14:01.928529 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-12d78cbf-be2c-4a28-b721-80079b504f3d admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:01.934413 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.wsgi [None req-12d78cbf-be2c-4a28-b721-80079b504f3d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-12d78cbf-be2c-4a28-b721-80079b504f3d admin admin] Request method failure captured: Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Accept: application/json Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Accept-Encoding: gzip, deflate Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Connection: keep-alive Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Content-Length: 0 Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Host: 10.222.0.15 Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Openstack-Api-Version: compute 2.90 Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Openstack-System-Scope: None Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: User-Agent: python-novaclient Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Auth-Token: gAAAAABi7Hzp0b2oe8wo1ZvgagJSMFK57HIqwrRGsIIEUXQaEhfmIr5w6HW0FauhK-6u7JVdc1FAUYtTu_JGE2QOLPwCazlSBECdojaLaSmKgAkJrn1TYhXFL9DpjOFuWZC3YZlHHSicLaKf0npurZohVV28IqOjRyutvls6PBnIMNWW4_7JRck Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Domain-Id: None Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Domain-Name: None Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Identity-Status: Confirmed Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Is-Admin-Project: True Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Project-Domain-Id: default Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Project-Domain-Name: Default Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Project-Id: a0be9d6a2aae470aa8143374d4c4992b Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Project-Name: admin Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Role: admin,reader,member Aug 05 02:14:01.935891 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Roles: admin,reader,member Aug 05 02:14:01.937440 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a0be9d6a2aae470aa8143374d4c4992b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a0be9d6a2aae470aa8143374d4c4992b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a0be9d6a2aae470aa8143374d4c4992b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a0be9d6a2aae470aa8143374d4c4992b"}]}] Aug 05 02:14:01.937440 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Tenant: admin Aug 05 02:14:01.937440 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Tenant-Id: a0be9d6a2aae470aa8143374d4c4992b Aug 05 02:14:01.937440 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Tenant-Name: admin Aug 05 02:14:01.937440 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-User: admin Aug 05 02:14:01.937440 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-User-Domain-Id: default Aug 05 02:14:01.937440 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-User-Domain-Name: Default Aug 05 02:14:01.937440 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-User-Id: c5c6e2a1691a410eaac17764c32341d7 Aug 05 02:14:01.937440 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-User-Name: admin Aug 05 02:14:01.937440 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: method: > Aug 05 02:14:01.937440 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: exception: Flavor 84 could not be found. Aug 05 02:14:01.937440 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: action_args: {'id': '84'} Aug 05 02:14:01.937440 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:14:01.937440 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:14:01.938248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Aug 05 02:14:01.939301 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-12d78cbf-be2c-4a28-b721-80079b504f3d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:14:01.940343 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-12d78cbf-be2c-4a28-b721-80079b504f3d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389802 Aug 05 02:14:01.940343 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Fri Aug 5 02:14:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:01.947064 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-b3146248-ed69-4270-ba79-a4c63fb6eb0b admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:01.961701 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-b3146248-ed69-4270-ba79-a4c63fb6eb0b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018254 Aug 05 02:14:01.962235 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Aug 5 02:14:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:14:01.971805 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-6d545683-1be3-4afe-89dd-6d9595125495 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:01.988789 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-6d545683-1be3-4afe-89dd-6d9595125495 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020648 Aug 05 02:14:01.989309 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Aug 5 02:14:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:14:01.999165 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-107a3ead-33ff-40b9-8f83-fb4456218bec admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:02.004463 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.wsgi [None req-107a3ead-33ff-40b9-8f83-fb4456218bec admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-107a3ead-33ff-40b9-8f83-fb4456218bec admin admin] Request method failure captured: Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Accept: application/json Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Accept-Encoding: gzip, deflate Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Connection: keep-alive Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Content-Length: 0 Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Host: 10.222.0.15 Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Openstack-Api-Version: compute 2.90 Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Openstack-System-Scope: None Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: User-Agent: python-novaclient Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Auth-Token: gAAAAABi7Hzp0b2oe8wo1ZvgagJSMFK57HIqwrRGsIIEUXQaEhfmIr5w6HW0FauhK-6u7JVdc1FAUYtTu_JGE2QOLPwCazlSBECdojaLaSmKgAkJrn1TYhXFL9DpjOFuWZC3YZlHHSicLaKf0npurZohVV28IqOjRyutvls6PBnIMNWW4_7JRck Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Domain-Id: None Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Domain-Name: None Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Identity-Status: Confirmed Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Is-Admin-Project: True Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Project-Domain-Id: default Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Project-Domain-Name: Default Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Project-Id: a0be9d6a2aae470aa8143374d4c4992b Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Project-Name: admin Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Role: admin,reader,member Aug 05 02:14:02.005948 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Roles: admin,reader,member Aug 05 02:14:02.007445 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a0be9d6a2aae470aa8143374d4c4992b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a0be9d6a2aae470aa8143374d4c4992b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a0be9d6a2aae470aa8143374d4c4992b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a0be9d6a2aae470aa8143374d4c4992b"}]}] Aug 05 02:14:02.007445 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Tenant: admin Aug 05 02:14:02.007445 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Tenant-Id: a0be9d6a2aae470aa8143374d4c4992b Aug 05 02:14:02.007445 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Tenant-Name: admin Aug 05 02:14:02.007445 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-User: admin Aug 05 02:14:02.007445 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-User-Domain-Id: default Aug 05 02:14:02.007445 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-User-Domain-Name: Default Aug 05 02:14:02.007445 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-User-Id: c5c6e2a1691a410eaac17764c32341d7 Aug 05 02:14:02.007445 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-User-Name: admin Aug 05 02:14:02.007445 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: method: > Aug 05 02:14:02.007445 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: exception: Flavor 84 could not be found. Aug 05 02:14:02.007445 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: action_args: {'id': '84'} Aug 05 02:14:02.007445 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:14:02.007445 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:14:02.008531 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Aug 05 02:14:02.009825 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-107a3ead-33ff-40b9-8f83-fb4456218bec admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:14:02.011078 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-107a3ead-33ff-40b9-8f83-fb4456218bec admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012308 Aug 05 02:14:02.011078 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Fri Aug 5 02:14:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:02.967382 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-6d545683-1be3-4afe-89dd-6d9595125495 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:02.968425 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-6d545683-1be3-4afe-89dd-6d9595125495 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 05 02:14:02.968822 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Aug 5 02:14:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:14:03.614325 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-e2e787ef-8b5d-4252-b314-c7c7c68660cc admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:03.620053 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.wsgi [None req-e2e787ef-8b5d-4252-b314-c7c7c68660cc admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-e2e787ef-8b5d-4252-b314-c7c7c68660cc admin admin] Request method failure captured: Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Accept: application/json Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Accept-Encoding: gzip, deflate Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Connection: keep-alive Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Content-Length: 0 Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Host: 10.222.0.15 Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Openstack-Api-Version: compute 2.90 Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Openstack-System-Scope: None Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: User-Agent: python-novaclient Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Auth-Token: gAAAAABi7HzqmrZps6kWFBeG-NncaOEKLu91j8fDC-JiGDB0Qh5ZumxB3qyQ4-gZGawbW64QCBRl7HuvpEg3EWP9425e691kmLMMGkx3HJ6ekdL64gTNUd_ZWncTqBbz8n3ojxL65IlDvLham9CNeQKd1jc-kODi_r63t3Mn0fIN2pjllqTV6NY Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Domain-Id: None Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Domain-Name: None Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Identity-Status: Confirmed Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Is-Admin-Project: True Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Project-Domain-Id: default Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Project-Domain-Name: Default Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Project-Id: a0be9d6a2aae470aa8143374d4c4992b Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Project-Name: admin Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Role: admin,reader,member Aug 05 02:14:03.622069 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Roles: admin,reader,member Aug 05 02:14:03.623653 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a0be9d6a2aae470aa8143374d4c4992b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a0be9d6a2aae470aa8143374d4c4992b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a0be9d6a2aae470aa8143374d4c4992b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a0be9d6a2aae470aa8143374d4c4992b"}]}] Aug 05 02:14:03.623653 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Tenant: admin Aug 05 02:14:03.623653 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Tenant-Id: a0be9d6a2aae470aa8143374d4c4992b Aug 05 02:14:03.623653 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-Tenant-Name: admin Aug 05 02:14:03.623653 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-User: admin Aug 05 02:14:03.623653 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-User-Domain-Id: default Aug 05 02:14:03.623653 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-User-Domain-Name: Default Aug 05 02:14:03.623653 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-User-Id: c5c6e2a1691a410eaac17764c32341d7 Aug 05 02:14:03.623653 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: X-User-Name: admin Aug 05 02:14:03.623653 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: method: > Aug 05 02:14:03.623653 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: exception: Flavor 451 could not be found. Aug 05 02:14:03.623653 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: action_args: {'id': '451'} Aug 05 02:14:03.623653 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:14:03.623653 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:14:03.624803 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: ERROR nova.api.openstack.wsgi Aug 05 02:14:03.626380 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-e2e787ef-8b5d-4252-b314-c7c7c68660cc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:14:03.627652 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-e2e787ef-8b5d-4252-b314-c7c7c68660cc admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.515787 Aug 05 02:14:03.627652 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Aug 5 02:14:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 517 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:03.632914 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-4d0c5d65-0dad-4a00-9049-dafe314da0f6 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:03.648181 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-4d0c5d65-0dad-4a00-9049-dafe314da0f6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018766 Aug 05 02:14:03.648735 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Aug 5 02:14:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:14:03.657868 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-974f82ac-f24f-47da-9140-3428ac07575a admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:03.672518 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-974f82ac-f24f-47da-9140-3428ac07575a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018096 Aug 05 02:14:03.673036 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Fri Aug 5 02:14:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:14:03.681963 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-c8403859-7299-453b-9fc0-c8b143f1326b admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:03.687955 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.wsgi [None req-c8403859-7299-453b-9fc0-c8b143f1326b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-c8403859-7299-453b-9fc0-c8b143f1326b admin admin] Request method failure captured: Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Accept: application/json Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Accept-Encoding: gzip, deflate Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Connection: keep-alive Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Content-Length: 0 Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Host: 10.222.0.15 Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Openstack-Api-Version: compute 2.90 Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Openstack-System-Scope: None Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: User-Agent: python-novaclient Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Auth-Token: gAAAAABi7HzqmrZps6kWFBeG-NncaOEKLu91j8fDC-JiGDB0Qh5ZumxB3qyQ4-gZGawbW64QCBRl7HuvpEg3EWP9425e691kmLMMGkx3HJ6ekdL64gTNUd_ZWncTqBbz8n3ojxL65IlDvLham9CNeQKd1jc-kODi_r63t3Mn0fIN2pjllqTV6NY Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Domain-Id: None Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Domain-Name: None Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Identity-Status: Confirmed Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Is-Admin-Project: True Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Openstack-Nova-Api-Version: 2.90 Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Project-Domain-Id: default Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Project-Domain-Name: Default Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Project-Id: a0be9d6a2aae470aa8143374d4c4992b Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Project-Name: admin Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Role: admin,reader,member Aug 05 02:14:03.689473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Roles: admin,reader,member Aug 05 02:14:03.691107 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a0be9d6a2aae470aa8143374d4c4992b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a0be9d6a2aae470aa8143374d4c4992b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a0be9d6a2aae470aa8143374d4c4992b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a0be9d6a2aae470aa8143374d4c4992b"}]}] Aug 05 02:14:03.691107 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Tenant: admin Aug 05 02:14:03.691107 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Tenant-Id: a0be9d6a2aae470aa8143374d4c4992b Aug 05 02:14:03.691107 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-Tenant-Name: admin Aug 05 02:14:03.691107 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-User: admin Aug 05 02:14:03.691107 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-User-Domain-Id: default Aug 05 02:14:03.691107 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-User-Domain-Name: Default Aug 05 02:14:03.691107 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-User-Id: c5c6e2a1691a410eaac17764c32341d7 Aug 05 02:14:03.691107 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: X-User-Name: admin Aug 05 02:14:03.691107 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: method: > Aug 05 02:14:03.691107 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: exception: Flavor 451 could not be found. Aug 05 02:14:03.691107 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: action_args: {'id': '451'} Aug 05 02:14:03.691107 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:14:03.691107 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:14:03.692059 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: ERROR nova.api.openstack.wsgi Aug 05 02:14:03.693206 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-c8403859-7299-453b-9fc0-c8b143f1326b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:14:03.694197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-c8403859-7299-453b-9fc0-c8b143f1326b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012337 Aug 05 02:14:03.694197 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Aug 5 02:14:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:04.664042 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-974f82ac-f24f-47da-9140-3428ac07575a admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:04.665124 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-974f82ac-f24f-47da-9140-3428ac07575a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 05 02:14:04.665520 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Aug 5 02:14:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:14:05.191716 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-ef78be53-4fe9-4033-b144-c4c913afaa03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:14:05.214319 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-ef78be53-4fe9-4033-b144-c4c913afaa03 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.411552 Aug 05 02:14:05.215354 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Fri Aug 5 02:14:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:14:06.175296 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-974f82ac-f24f-47da-9140-3428ac07575a admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:06.176303 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-974f82ac-f24f-47da-9140-3428ac07575a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 05 02:14:06.176720 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Aug 5 02:14:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:14:06.699331 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-87d2b952-5eb0-494e-a3d7-4ac3255b7d4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:14:06.718704 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-87d2b952-5eb0-494e-a3d7-4ac3255b7d4b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.403861 Aug 05 02:14:06.719191 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Fri Aug 5 02:14:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 02:14:07.692392 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-974f82ac-f24f-47da-9140-3428ac07575a admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:07.693482 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-974f82ac-f24f-47da-9140-3428ac07575a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Aug 05 02:14:07.693883 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Aug 5 02:14:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:14:08.214676 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-c834b502-11bf-4c6c-b138-8f475c01fdf6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:14:08.236310 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-c834b502-11bf-4c6c-b138-8f475c01fdf6 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.404876 Aug 05 02:14:08.236875 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Fri Aug 5 02:14:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:14:09.329041 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-974f82ac-f24f-47da-9140-3428ac07575a admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:09.330093 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-974f82ac-f24f-47da-9140-3428ac07575a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Aug 05 02:14:09.330492 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Aug 5 02:14:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:14:09.858310 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-55b24bc7-178d-4efb-9895-ede698f9b758 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:14:09.877720 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-55b24bc7-178d-4efb-9895-ede698f9b758 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.403514 Aug 05 02:14:09.878269 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Fri Aug 5 02:14:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:14:10.840773 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-974f82ac-f24f-47da-9140-3428ac07575a admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:10.841801 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-974f82ac-f24f-47da-9140-3428ac07575a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Aug 05 02:14:10.842205 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Aug 5 02:14:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:14:11.356631 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-a3ecdefc-f5f0-475b-bc9b-ac60527c519c admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:14:11.376956 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-a3ecdefc-f5f0-475b-bc9b-ac60527c519c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.397359 Aug 05 02:14:11.377484 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Fri Aug 5 02:14:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:15:03.252538 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-974f82ac-f24f-47da-9140-3428ac07575a admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:15:03.253543 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-974f82ac-f24f-47da-9140-3428ac07575a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 05 02:15:03.253940 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Fri Aug 5 02:15:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:15:03.264444 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:15:03.645075 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-0a2ebe22-6ad1-4cdb-a17c-1eb422a2ae61 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:15:03.665521 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-0a2ebe22-6ad1-4cdb-a17c-1eb422a2ae61 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405600 Aug 05 02:15:03.665989 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Fri Aug 5 02:15:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:15:03.687078 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG dbcounter [-] [103410] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:15:03.690812 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-c12ed28b-ea78-414f-98de-7d614981214b admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:15:03.698930 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-c12ed28b-ea78-414f-98de-7d614981214b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013225 Aug 05 02:15:03.699442 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Fri Aug 5 02:15:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:15:03.710842 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-e25b2be8-57ea-411c-b4c8-fb9f699fb539 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:15:03.718970 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-e25b2be8-57ea-411c-b4c8-fb9f699fb539 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011713 Aug 05 02:15:03.719473 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Fri Aug 5 02:15:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:15:03.730791 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-e54ab6d6-4094-4dca-90d5-57417f89d4f1 admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:15:03.738958 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-e54ab6d6-4094-4dca-90d5-57417f89d4f1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011817 Aug 05 02:15:03.739467 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Fri Aug 5 02:15:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:15:03.750683 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-aa56eeb5-e47d-4ded-928b-c2617107c662 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:15:03.758182 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-aa56eeb5-e47d-4ded-928b-c2617107c662 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011055 Aug 05 02:15:03.758693 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Fri Aug 5 02:15:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:18:19.695332 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-e54ab6d6-4094-4dca-90d5-57417f89d4f1 admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:18:19.696361 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-e54ab6d6-4094-4dca-90d5-57417f89d4f1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 05 02:18:19.696755 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Aug 5 02:18:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:18:19.834128 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_api:SELECT=6 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:18:19.992399 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-1c2e213c-d923-44f5-a715-e955ee2cd237 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:18:19.994836 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:18:19.994836 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: warnings.warn(msg) Aug 05 02:18:19.995984 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-1c2e213c-d923-44f5-a715-e955ee2cd237 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:18:19.996497 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-1c2e213c-d923-44f5-a715-e955ee2cd237 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:18:19.996924 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-1c2e213c-d923-44f5-a715-e955ee2cd237 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:18:19.997641 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-1c2e213c-d923-44f5-a715-e955ee2cd237 admin admin] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:18:19.998082 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-1c2e213c-d923-44f5-a715-e955ee2cd237 admin admin] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:18:19.998501 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-1c2e213c-d923-44f5-a715-e955ee2cd237 admin admin] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:18:20.035097 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-1c2e213c-d923-44f5-a715-e955ee2cd237 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.202353 Aug 05 02:18:20.036379 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Aug 5 02:18:19 2022] GET /compute/v2.1/os-services => generated 794 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:18:20.851618 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-e54ab6d6-4094-4dca-90d5-57417f89d4f1 admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:18:20.852648 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-e54ab6d6-4094-4dca-90d5-57417f89d4f1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 05 02:18:20.853046 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Aug 5 02:18:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:18:21.039941 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-bd6629d3-5c90-4da8-8615-0d051ad02e44 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:18:21.042321 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:18:21.042321 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: warnings.warn(msg) Aug 05 02:18:21.043449 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-bd6629d3-5c90-4da8-8615-0d051ad02e44 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:18:21.043944 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-bd6629d3-5c90-4da8-8615-0d051ad02e44 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:18:21.044388 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-bd6629d3-5c90-4da8-8615-0d051ad02e44 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:18:21.045096 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-bd6629d3-5c90-4da8-8615-0d051ad02e44 admin admin] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:18:21.045535 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-bd6629d3-5c90-4da8-8615-0d051ad02e44 admin admin] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:18:21.045943 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-bd6629d3-5c90-4da8-8615-0d051ad02e44 admin admin] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:18:21.065454 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-bd6629d3-5c90-4da8-8615-0d051ad02e44 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076812 Aug 05 02:18:21.065992 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Aug 5 02:18:20 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:18:32.312585 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-e54ab6d6-4094-4dca-90d5-57417f89d4f1 admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:18:32.314211 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-e54ab6d6-4094-4dca-90d5-57417f89d4f1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 05 02:18:32.314606 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Aug 5 02:18:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:18:32.456283 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_cell0:SELECT=4 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:18:32.457030 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_cell1:SELECT=4 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:18:32.457642 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG dbcounter [-] [103409] Writing DB stats nova_api:SELECT=8 {{(pid=103409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:18:32.505824 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-4a9e4d47-8e8a-4064-8db3-e342d01a9c15 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:18:32.508215 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:18:32.508215 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: warnings.warn(msg) Aug 05 02:18:32.509383 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-4a9e4d47-8e8a-4064-8db3-e342d01a9c15 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:18:32.509889 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-4a9e4d47-8e8a-4064-8db3-e342d01a9c15 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:18:32.510316 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-4a9e4d47-8e8a-4064-8db3-e342d01a9c15 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:18:32.511034 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-4a9e4d47-8e8a-4064-8db3-e342d01a9c15 admin admin] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:18:32.511480 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-4a9e4d47-8e8a-4064-8db3-e342d01a9c15 admin admin] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:18:32.511897 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-4a9e4d47-8e8a-4064-8db3-e342d01a9c15 admin admin] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:18:32.536949 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-4a9e4d47-8e8a-4064-8db3-e342d01a9c15 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.085096 Aug 05 02:18:32.537439 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Aug 5 02:18:32 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:18:33.359085 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: DEBUG nova.api.openstack.wsgi [None req-e54ab6d6-4094-4dca-90d5-57417f89d4f1 admin admin] Calling method '>' {{(pid=103410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:18:33.360089 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: INFO nova.api.openstack.requestlog [None req-e54ab6d6-4094-4dca-90d5-57417f89d4f1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 05 02:18:33.360520 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: [pid: 103410|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Fri Aug 5 02:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:18:33.561846 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG nova.api.openstack.wsgi [None req-987f0613-6d94-49d2-8ec9-cdc4847bd987 admin admin] Calling method '>' {{(pid=103409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:18:33.564248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:18:33.564248 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: warnings.warn(msg) Aug 05 02:18:33.565727 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-987f0613-6d94-49d2-8ec9-cdc4847bd987 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:18:33.566196 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-987f0613-6d94-49d2-8ec9-cdc4847bd987 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:18:33.566613 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-987f0613-6d94-49d2-8ec9-cdc4847bd987 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:18:33.567374 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-987f0613-6d94-49d2-8ec9-cdc4847bd987 admin admin] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:18:33.567750 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-987f0613-6d94-49d2-8ec9-cdc4847bd987 admin admin] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:18:33.568155 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: DEBUG oslo_concurrency.lockutils [None req-987f0613-6d94-49d2-8ec9-cdc4847bd987 admin admin] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:18:33.589751 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: INFO nova.api.openstack.requestlog [None req-987f0613-6d94-49d2-8ec9-cdc4847bd987 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079733 Aug 05 02:18:33.590283 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: [pid: 103409|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Fri Aug 5 02:18:33 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:19:29.415699 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: Fri Aug 5 02:19:29 2022 - graceful shutdown triggered... Aug 05 02:19:29.416196 dv-cinder-815582-13-iscsi devstack@n-api.service[103410]: Gracefully killing worker 2 (pid: 103410)... Aug 05 02:19:29.415827 dv-cinder-815582-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 05 02:19:29.417083 dv-cinder-815582-13-iscsi devstack@n-api.service[103409]: Gracefully killing worker 1 (pid: 103409)... Aug 05 02:19:30.416844 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: worker 1 buried after 1 seconds Aug 05 02:19:30.417393 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: worker 2 buried after 1 seconds Aug 05 02:19:30.417393 dv-cinder-815582-13-iscsi devstack@n-api.service[103408]: goodbye to uWSGI. Aug 05 02:19:30.418408 dv-cinder-815582-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 05 02:19:30.418951 dv-cinder-815582-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 05 02:19:30.421796 dv-cinder-815582-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 05 02:19:30.431425 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 05 02:19:30.434012 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 02:19:30 2022] *** Aug 05 02:19:30.434169 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 02:19:30.434293 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 02:19:30.434419 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: nodename: dv-cinder-815582-13-iscsi Aug 05 02:19:30.434531 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: machine: x86_64 Aug 05 02:19:30.434642 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: clock source: unix Aug 05 02:19:30.434770 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: pcre jit disabled Aug 05 02:19:30.434770 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: detected number of CPU cores: 4 Aug 05 02:19:30.434770 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: current working directory: / Aug 05 02:19:30.434770 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: detected binary path: /usr/bin/uwsgi-core Aug 05 02:19:30.434770 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: your processes number limit is 47680 Aug 05 02:19:30.434770 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: your memory page size is 4096 bytes Aug 05 02:19:30.434770 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: detected max file descriptor number: 2048 Aug 05 02:19:30.434770 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: lock engine: pthread robust mutexes Aug 05 02:19:30.435301 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: thunder lock: enabled Aug 05 02:19:30.435301 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 05 02:19:30.435301 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 02:19:30.475514 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: Python main interpreter initialized at 0x56172426c9c0 Aug 05 02:19:30.475514 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: python threads support enabled Aug 05 02:19:30.475514 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: your server socket listen backlog is limited to 100 connections Aug 05 02:19:30.475514 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: your mercy for graceful operations on workers is 90 seconds Aug 05 02:19:30.475985 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 02:19:30.475985 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: *** Operational MODE: preforking *** Aug 05 02:19:30.476219 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: *** uWSGI is running in multiple interpreter mode *** Aug 05 02:19:30.476219 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: spawned uWSGI master process (pid: 117902) Aug 05 02:19:30.476457 dv-cinder-815582-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 05 02:19:30.476990 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: spawned uWSGI worker 1 (pid: 117920, cores: 1) Aug 05 02:19:30.477482 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: spawned uWSGI worker 2 (pid: 117921, cores: 1) Aug 05 02:19:30.477801 dv-cinder-815582-13-iscsi devstack@n-api.service[117902]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 02:19:31.147497 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 02:19:31.158459 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 05 02:19:32.296985 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 02:19:32.296985 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: from cryptography.utils import int_from_bytes Aug 05 02:19:32.297710 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 02:19:32.297710 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: from cryptography.utils import int_from_bytes Aug 05 02:19:32.353943 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 02:19:32.353943 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: from cryptography.utils import int_from_bytes Aug 05 02:19:32.354416 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 02:19:32.354416 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: from cryptography.utils import int_from_bytes Aug 05 02:19:34.609251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 02:19:34.609836 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 02:19:34.610696 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 02:19:34.610944 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 02:19:34.611203 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 02:19:34.611590 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.611915 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.612235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.612579 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.612909 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.613225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.613537 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.613886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.614171 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.614427 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.614745 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.615065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-13-iscsi {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.615382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.615687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.615995 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.616310 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.616633 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.616951 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.617263 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.617756 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.619232 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.619232 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.619232 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.619232 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.619559 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.619780 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.620014 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.620312 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.620681 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.620970 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.621370 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-13-iscsi {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.621693 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.622019 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.622320 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.622725 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.623054 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.623356 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.623662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.623985 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.624312 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.624644 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.624961 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.625281 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.625599 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.625929 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.626236 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.626547 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.626863 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.627168 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.627470 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.627728 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.628031 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.628369 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.628691 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.629053 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.629263 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.629513 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.629831 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.630149 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.630458 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.630766 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.631071 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.631369 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.631679 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.631984 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.632288 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.632622 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.632933 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.633244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.633565 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.633872 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.634187 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.634585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.634841 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.635146 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.635483 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.635798 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.636104 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.636443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.636762 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.637069 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.637375 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.637677 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.637995 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.638325 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.638629 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.638879 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.639180 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.639484 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.639799 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.640102 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.640448 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.640751 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.641047 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.641381 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.641720 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.642090 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.642281 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.642579 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.642885 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.643190 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.643492 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.643796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.644115 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.644451 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.644761 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.645065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.645371 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.645672 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.645988 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.646291 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.646595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.646914 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.647221 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.647526 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.647840 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.648147 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.648472 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.648788 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.649087 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.649392 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.649704 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.650007 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.650309 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.650616 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.650921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.651221 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.651525 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.651828 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.652203 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.652448 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.652766 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.653086 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.653395 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.653698 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.654002 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.654320 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.654654 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.654983 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.655325 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.655643 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.655972 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.656304 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.656643 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.658319 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.658319 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.658319 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.658793 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.658944 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.659179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.659497 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.659817 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.660145 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.660913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.660913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.661214 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.661451 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.661723 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.662052 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.662385 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.662684 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.663025 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.663369 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.663682 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.664001 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.664381 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.664652 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.664964 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.665269 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.665593 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.665926 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.666233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.666549 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.666859 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.667169 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.667479 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.667790 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.668100 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.668550 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.668770 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.669085 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.669394 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.669712 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.670023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.670333 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.670643 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.670947 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.671257 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.671565 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.671865 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.672166 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.672517 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.673442 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.673785 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.674082 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.674392 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.674707 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.675019 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.675330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.675636 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.676011 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.676255 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.676586 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.676909 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.677218 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.677525 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.677848 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.678152 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.678467 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.678772 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.679082 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.679393 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.679706 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.680524 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.680524 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.680832 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.681006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.681289 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.681613 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.681922 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.682239 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.682625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.682872 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.683174 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.683498 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.683783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.684089 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.684411 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.684722 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.685022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.685326 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.685629 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.685934 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.686238 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.686555 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.686859 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.687160 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.687464 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.687766 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.688109 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.688465 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.688808 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.689142 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.689458 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.689780 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.690092 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.690406 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.690717 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.691026 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.691340 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.691649 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.691967 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.692271 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.692669 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.692916 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.693226 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.693610 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.693855 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.694159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.694470 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.695549 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.695549 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.695549 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.696015 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.696015 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.696414 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.696762 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.696975 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.697283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.697590 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.697905 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.698212 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.698530 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.698840 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.699241 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.699464 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.699778 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.700081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.700417 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.700748 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.701082 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.701390 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.701701 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.702080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.702323 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.702631 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.702941 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.703237 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.703541 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.703876 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.704256 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.704520 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.704831 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.705722 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.705722 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.705722 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.706038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.707839 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.707839 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.707839 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.707839 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.707839 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.707839 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.708286 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.708502 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.712349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.712349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.712349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.712349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.712349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.712349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.712349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.712349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.712949 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.712949 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.712949 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.712949 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.712949 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.712949 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.713334 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.713334 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.713646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.713901 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.714212 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.714520 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.714827 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.715149 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.715462 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.715800 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.716112 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.716443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.716753 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.717068 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.717657 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.717993 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.718309 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.718632 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.718948 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.719269 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.724395 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.724395 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.724395 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.724395 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.724395 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.724395 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.724395 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.724395 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.725093 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.725093 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.725093 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.725093 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.725093 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.725093 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.725093 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.725093 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.725773 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.725773 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.725773 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.726129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.726382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.726691 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.726995 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.727299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.727601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.727943 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.728247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.728609 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.728938 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.729280 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.729585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.729890 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.730213 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.730516 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.730818 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.731119 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.731430 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.731746 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.732048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.732383 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.732697 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.733004 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.733313 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.733615 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.733921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.734223 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.734536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.734843 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.735692 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.736003 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.736313 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.736648 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.736946 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.737252 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.737557 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.737869 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.738178 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.738478 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.738780 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.739089 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.739400 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.739700 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.740029 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.740358 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.740663 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.740967 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.741276 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.741584 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.741886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.742194 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.742506 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.742829 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.743126 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.743437 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.743742 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.744043 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.744370 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.744682 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.744983 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.745285 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.745587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.745892 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.746194 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.746515 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.746823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.747128 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.747431 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.747734 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.748076 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.748405 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.748760 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.749067 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.749398 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.749706 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.750013 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.750324 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.750659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.751117 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.751504 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.751933 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.752302 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.752601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.752945 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.753225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.753537 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.753848 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.754165 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.754487 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.754806 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.755110 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.755420 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.755728 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.756037 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.756289 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 02:19:34.756827 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.756977 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 02:19:34.757114 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.757114 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.757392 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 02:19:34.757528 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.757678 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 02:19:34.757838 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.757983 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 02:19:34.758134 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.758282 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.758630 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.758784 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.758921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.759066 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.759210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.759357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.759493 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.759655 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.759860 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.760037 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.760194 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.760345 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.760495 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.760643 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.760800 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.760945 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.761081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.761215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.761349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.761484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.761628 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.761783 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-13-iscsi {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.761930 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.762075 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.762209 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.762356 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.762579 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.762732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.762909 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.763124 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.763273 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.763420 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.763588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.763809 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.764038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.764184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.764319 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.764555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.764725 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.764863 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.765038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.765177 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.765319 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.765472 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.765619 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.765755 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.765898 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.766032 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.766166 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.766815 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.766916 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.766997 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.767265 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.767420 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.767571 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.767721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.767873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.768068 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.768214 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.768378 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-13-iscsi {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.768567 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.768922 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.769076 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.769219 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.769366 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.769516 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.769670 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.769826 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.770058 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.770217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.770375 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.770638 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.770785 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.770928 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.771076 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.771227 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.771377 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.771528 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.771669 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.771809 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.771950 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.772108 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.772258 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.772443 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.772603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.772831 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.773026 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.773189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.773189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.773551 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.773701 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.773859 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.774096 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.774310 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.774477 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.774701 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.774858 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.775007 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.775151 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.775291 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.775444 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.775592 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.775735 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.775882 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.776023 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.776165 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.776369 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.776534 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.776675 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.776835 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.776984 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.777140 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.777289 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.777289 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.777557 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.777705 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.777870 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.778106 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.778271 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.778421 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.778561 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.778709 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.779085 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.779254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.779399 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.780107 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.780353 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.780506 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.780658 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.780812 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.780953 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.781103 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.781484 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.781638 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.781781 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.782017 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.782696 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.782874 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.783325 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.783577 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.783731 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.783731 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.784056 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.784056 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.784537 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.784811 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.784961 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.785112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.785264 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.785407 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.785555 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.785704 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.785853 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.785853 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.786143 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.786306 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.786456 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.786733 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.786903 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.787056 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.787207 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.787349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.787499 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.787640 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.787789 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.787944 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.792506 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.794182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.794446 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.794524 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.794611 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.794686 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.794766 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.794851 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.794924 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.794994 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.795063 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.795138 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.795218 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.795218 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.795355 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.795425 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.795495 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.795570 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.795649 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.795721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.795798 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.795897 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.795985 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.796059 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.796142 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.796214 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.796284 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.796398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.796476 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.796562 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.796643 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.796730 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.796813 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.796895 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.796985 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.797080 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.797165 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.797248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.797331 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.797414 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.797501 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.797643 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.797730 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.797822 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.797919 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.798004 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.798088 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.798187 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.798272 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.798368 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.798502 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.798597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.798682 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.798771 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.798864 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.798948 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.799045 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.799132 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.799216 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.799299 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.799389 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.799483 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.799570 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.799657 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.799749 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.799834 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.799917 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.800013 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.800099 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.800182 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.800264 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.800388 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.800471 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.800575 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.800663 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.800754 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.800846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.800931 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.801021 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.801114 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.801199 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.801282 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.801372 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.801456 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.801548 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.801640 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.801724 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.801815 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.801900 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.801989 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.802082 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.802168 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.802259 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.802353 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.802353 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.802523 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.802687 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.802781 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.802872 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.802957 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.803047 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.803131 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.803229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:19:34.803315 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.803406 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.803497 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.803588 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.803682 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.803767 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.803850 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.803960 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.804069 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.804163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.804257 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.804895 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.804998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.805100 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.805187 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.805271 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.805364 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.805451 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.805542 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.805636 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.805729 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.805829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.805916 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.806007 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.806093 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.806177 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.806268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.806362 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.806447 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.806539 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.806631 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.806717 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.806813 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.806906 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.806991 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.807083 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.807175 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.807268 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.807421 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.807514 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.807599 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.807696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.807783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.807873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.807967 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.808054 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.808138 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.808221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.808305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.808444 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.808531 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.808620 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.808713 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.808800 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.808884 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.808976 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.809062 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.809185 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.809291 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.809494 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.809591 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.809803 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.809907 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.810113 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.810209 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.810436 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.810537 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.810772 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.810866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.811088 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.811295 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.811398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.811608 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.811703 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.811938 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.812038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.812261 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.812387 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.812605 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.812698 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.812913 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.813008 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.813283 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.813385 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.813598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.813837 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.813953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.814086 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.814189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.814392 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.814495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.814705 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.814805 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.815016 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.815123 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.815319 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.815423 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.815642 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.815743 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.815953 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.816051 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.816251 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.816407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.816582 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.816684 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.816883 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.816983 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.817198 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.817413 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.817506 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.817763 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.817856 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.818081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.818189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.818404 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.818498 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.818749 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.818845 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.819045 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.819352 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.819675 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.819908 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.820004 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.820245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.820358 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.820628 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.820907 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.821002 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.821226 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.821376 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.821531 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.821798 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.821892 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.822135 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.822247 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.822439 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.823813 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.823931 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.824020 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.824115 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.824202 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.824286 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.825294 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.825419 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.825419 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.825591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.825685 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.825788 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.825883 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.825975 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.826067 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.826160 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.826246 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.826246 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.826246 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.826493 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.826580 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.826580 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.826741 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.826833 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.826920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.828366 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.828507 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.828605 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.828692 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.829308 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.829403 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.829496 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.829589 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.829673 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.829771 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.829856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.829856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.830103 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.830204 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.830204 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.830458 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.830562 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.830803 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.831071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.831172 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.831443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.831552 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.831756 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.831971 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.832395 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.832499 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.832683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.832814 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.833007 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.833222 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.833334 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.834031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.834131 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.834223 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.834313 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.834420 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.834513 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.834605 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.834688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.834769 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.834851 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.835073 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.835186 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.835382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.835482 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.835687 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.835787 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.836009 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.836115 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.836348 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.836456 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.836646 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.836727 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.836957 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.837066 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.837262 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.837361 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.837568 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.837647 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.837877 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.838030 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.838185 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.838275 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.838491 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.838580 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.838800 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.838890 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.839109 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.839190 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.839426 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.839517 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.839751 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.839844 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.840062 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.840153 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.840431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.840529 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.840714 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.840827 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.841046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.841152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.841335 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.841477 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.841642 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.841795 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.841951 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.842114 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.842260 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.842424 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.842648 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.842763 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.842899 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.843042 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.843223 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.843398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.843524 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.843660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.843948 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.844055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.844261 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.844421 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.845251 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.845390 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.845571 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.845724 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.845892 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.846036 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.846202 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.846350 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.846555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.846697 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.846857 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.847011 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.847205 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.847419 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.847819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.847974 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.848113 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.848250 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.848444 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.848586 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.848723 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.848860 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.848990 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.849118 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.849255 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.849404 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.849549 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.849679 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.849814 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.849977 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.850119 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.850287 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.850427 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.850605 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.850746 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.850914 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.851064 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.851341 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.851482 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.851612 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.851738 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.851874 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.852011 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.852140 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.852277 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.852424 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.852554 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.852719 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.852864 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.853026 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.853167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.853337 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.853500 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.853672 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.853814 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.853993 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.854126 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.854262 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.854398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.854527 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.854663 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.854806 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.854935 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.855084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.855216 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.855418 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.855557 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.855715 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.855846 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.855973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.856108 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.856245 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.856408 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.856581 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.856714 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.856922 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.857071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.857261 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.857380 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.857575 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.857679 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.857896 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.858009 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.858198 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.858321 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.858500 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.858612 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.858815 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.858919 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.859119 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.859232 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.859420 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.859530 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.859720 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.859830 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.860057 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.860185 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.860422 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.860581 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.860804 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.860943 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.861117 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.861389 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.861523 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.861659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.861789 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.861916 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.862057 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.862189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.862316 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.862452 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.862621 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.862752 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.862932 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.863057 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.863250 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.863355 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.863560 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.863672 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.863863 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.863973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.864171 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.864282 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.864504 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.864622 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.864811 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.864914 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.865117 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.865220 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.865433 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.865590 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.865736 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.865848 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.866035 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.866181 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.866329 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.866459 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.866629 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.866844 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.866993 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.867197 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.867360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.867578 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.867783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.867924 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.868053 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.868181 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.868318 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.868550 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.868714 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.868861 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.868992 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.869120 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.869261 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.869399 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.869536 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.869679 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.869820 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.870006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.870139 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.870348 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.870479 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.870640 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.870769 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.870955 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.871094 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.871260 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.871539 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.871685 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.871816 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.871951 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.872080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.872230 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.872444 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.872444 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 02:19:34.872696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.872825 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.873047 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.873350 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.873655 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.873956 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.874259 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.874574 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.874875 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.875184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.875490 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.875916 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.876357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.876666 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.876971 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.877273 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.877617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.877922 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.878264 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.878590 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.878927 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.879282 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.879534 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.879854 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.880156 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.880483 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.880792 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.881100 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.881406 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.881776 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.882003 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.882311 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.882617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.882923 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.883222 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.883526 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.883825 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.884184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.884468 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.884769 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.885068 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.885374 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.885713 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.885974 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.886281 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.886581 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.886896 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.887188 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.887486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.887788 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.888080 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.888411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.888713 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.889039 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.889349 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.889652 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.889955 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.890261 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.890561 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.890867 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.891173 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.892076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.892502 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.892813 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.893125 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.893431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.893742 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.894044 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.894351 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.894653 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.894955 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.895255 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.895556 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.895860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.896179 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.896511 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.896815 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.897126 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.897422 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.897765 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.898066 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.898421 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.898724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.899037 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.899355 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.899666 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.899976 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.900288 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.900615 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.900929 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.901239 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.901556 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.901859 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.902225 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.902501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.902792 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.903101 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.903418 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.903739 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.904061 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.904385 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.904699 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.905010 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.905316 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.905625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.905932 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.906244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.906553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.907011 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.907898 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.908599 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.908599 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.908770 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.909037 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.909341 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.909667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.909974 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.910278 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.910587 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.910890 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.911200 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.911507 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.911948 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.912257 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.912594 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.912897 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.913207 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.913516 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.913831 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.914145 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.914447 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.914870 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.915182 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.915492 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.915803 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.916108 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.916437 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.916745 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.917070 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.917373 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.917677 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.917981 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.918302 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.918610 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.918926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.919354 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.919668 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.919972 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.920407 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.920721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.921031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.921351 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.921678 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.921999 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.922303 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.922700 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.923057 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.923380 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.923706 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.924012 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.924353 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.924650 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.924973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.925292 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.925603 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.925921 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.926352 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.926669 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.926980 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.927303 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.927626 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.927928 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.928232 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.928566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.929060 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.929215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.929470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.929773 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.930082 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.930392 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.930701 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.931004 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.931307 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.931632 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.931933 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.932251 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.932596 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.932921 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.933240 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.933544 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.933864 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.934171 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.934475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.934777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.935079 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.935419 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.935722 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.936041 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.936436 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.936715 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.937024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.937356 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.937679 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.937991 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.938557 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.939036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.939339 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.939643 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.939954 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.940257 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.940587 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.940889 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.941196 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.941497 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.941801 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.942103 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.942423 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.942724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.943062 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.943347 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.943648 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.943951 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.944250 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.944619 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.944923 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.945252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.945561 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.945886 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.946203 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.946523 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.946836 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.947146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.947458 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.947770 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.948083 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.948419 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.948735 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.949048 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.949364 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.949937 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.950264 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.950577 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.950886 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.951195 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.951507 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.951830 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.952137 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.952464 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.952773 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.953081 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.953408 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.954282 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.954623 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.954951 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.955268 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.955581 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.955894 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.956204 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.956592 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.956909 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.957210 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.957522 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.957833 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.958144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.958454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.958762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.959074 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.959388 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.959697 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.960003 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.960313 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.960645 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.960968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.961297 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.961618 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.961929 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.962248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.962561 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.963113 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.963424 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.963751 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.964072 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.964412 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.964729 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.965044 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.965369 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.965673 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.965973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.966284 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.966592 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.966894 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.967213 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.967518 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.967819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.968138 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.968467 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.968996 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.969340 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.970359 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.970678 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.971001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.971317 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.971621 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.971942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.972253 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.972834 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.973160 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.973455 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.973759 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.974061 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.974370 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.974677 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.974976 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.975281 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.975581 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.975903 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.976205 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.976530 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.976835 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.977210 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.977445 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.977749 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.978053 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.978353 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.978660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.978960 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.979283 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.979566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.979875 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.980175 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.980503 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.980807 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.981123 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.981428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.981782 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.982096 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.982409 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.982727 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.983035 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.983354 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.983684 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.983995 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.984550 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.984882 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.985257 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.985667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.986013 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.986320 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.986626 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.986933 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.987266 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.987562 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.987871 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.988179 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.988510 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.988822 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.989130 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.989439 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.989747 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.990056 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.990362 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.990669 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.990975 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.991282 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.991589 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.991901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.992238 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.992581 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.992899 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.993214 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.993527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.993833 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.994143 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.994445 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.994749 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.995062 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.995389 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.995698 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.996000 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.996442 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.996753 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.997068 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.997386 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.997821 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.998006 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.998316 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.998623 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.998939 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.999247 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.999575 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:34.999908 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.000231 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.000572 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.001098 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.001546 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.001855 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.002164 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.002486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.002791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.003092 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.003391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.003697 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.003997 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.004363 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.004610 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.004910 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.005216 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.005516 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.005815 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.006114 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.006436 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.006712 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.007011 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.007317 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.007616 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.007918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.008217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.008542 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.008855 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.009168 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.009496 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.009807 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.010126 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.010433 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.010749 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.011055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.011370 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.011685 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.011997 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.012307 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.012655 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.012962 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.013270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.013577 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.013884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.014191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.014501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.014822 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.015146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.015447 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.015766 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.016079 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.017115 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.017479 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.017794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.018122 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.018434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.018744 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.019051 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.019360 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.019668 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.019982 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.020290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.020623 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.020938 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.021118 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO dbcounter [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] Registered counter for database nova_api Aug 05 02:19:35.021248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.021570 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.021891 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.022198 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.022521 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.022847 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.023190 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.023499 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.023836 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.024161 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.024500 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.024812 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.025114 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:19:35.025352 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 02:19:35.042379 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_db.sqlalchemy.engines [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:19:35.050088 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writer thread running {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:19:35.109520 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.context [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6a4fb03c-ecbf-4928-85f2-a2fa83e41a91(cell1) {{(pid=117921) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 02:19:35.113897 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:19:35.114397 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:19:35.116025 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:19:35.116792 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:19:35.117241 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:19:35.119246 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:19:35.121279 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO dbcounter [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] Registered counter for database nova_cell0 Aug 05 02:19:35.125376 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO dbcounter [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] Registered counter for database nova_cell1 Aug 05 02:19:35.133388 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_db.sqlalchemy.engines [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:19:35.136414 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_db.sqlalchemy.engines [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:19:35.139663 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writer thread running {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:19:35.176372 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] Registered counter for database nova_api Aug 05 02:19:35.196648 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:19:35.203452 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:19:35.260714 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.context [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6a4fb03c-ecbf-4928-85f2-a2fa83e41a91(cell1) {{(pid=117920) load_cells /opt/stack/nova/nova/context.py:464}} Aug 05 02:19:35.265428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:19:35.265428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:19:35.267712 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:19:35.268477 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:19:35.268929 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:19:35.271841 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:19:35.273986 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] Registered counter for database nova_cell0 Aug 05 02:19:35.278272 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] Registered counter for database nova_cell1 Aug 05 02:19:35.279516 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writer thread running {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:19:35.286726 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:19:35.288528 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:19:35.290999 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO dbcounter [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] Registered counter for database nova_cell0 Aug 05 02:19:35.295185 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:19:35.296484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:19:35.297838 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_db.sqlalchemy.engines [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:19:35.302811 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writer thread running {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:19:35.444004 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] Registered counter for database nova_cell0 Aug 05 02:19:35.450770 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:19:35.456492 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:19:35.619282 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: WARNING keystonemiddleware.auth_token [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 02:19:35.627167 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: WARNING keystonemiddleware.auth_token [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 02:19:35.775411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 02:19:35.782678 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 02:19:35.988660 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: WARNING keystonemiddleware.auth_token [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 02:19:35.995033 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: WARNING keystonemiddleware.auth_token [None req-04fbec92-8b74-4398-8d27-31a862a74390 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 02:19:36.002281 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56172426c9c0 pid: 117921 (default app) Aug 05 02:19:36.135283 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 05 02:19:36.141132 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-a9b03916-e9e7-4177-88d3-c7ce4d2703c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 05 02:19:36.147531 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56172426c9c0 pid: 117920 (default app) Aug 05 02:20:11.347279 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:11.348246 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:11.349032 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:11.349987 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:12.902675 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-902edbbb-ebc9-4b16-8753-ef2b9a9ba45e tempest-VolumesGetTestJSON-1569247326 tempest-VolumesGetTestJSON-1569247326-project] Action: 'create', calling method: .version_select at 0x7fa65e625dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1309425615", "metadata": {"Type": "work"}}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:20:14.060096 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-902edbbb-ebc9-4b16-8753-ef2b9a9ba45e tempest-VolumesGetTestJSON-1569247326 tempest-VolumesGetTestJSON-1569247326-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.749136 Aug 05 02:20:14.061180 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1156 bytes} [Fri Aug 5 02:20:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2752 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 05 02:20:14.635542 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f6aa9754-c81e-4cc8-a8df-50070ff1401b tempest-VolumesGetTestJSON-1569247326 tempest-VolumesGetTestJSON-1569247326-project] Calling method '.version_select at 0x7fa65e6f9940>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:14.678196 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:14.679110 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:14.680258 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:14.681086 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:15.318872 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f6aa9754-c81e-4cc8-a8df-50070ff1401b tempest-VolumesGetTestJSON-1569247326 tempest-VolumesGetTestJSON-1569247326-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b7a97103-2ca0-416c-8acb-57470bc2ce38" status: 200 len: 354 microversion: 2.1 time: 1.242934 Aug 05 02:20:15.319475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 1/2] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Aug 5 02:20:14 2022] GET /compute/v2.1/os-volumes/b7a97103-2ca0-416c-8acb-57470bc2ce38 => generated 354 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:20:15.333191 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e6cd5ba6-2cac-4efe-8513-7df43b7c8abb tempest-VolumesGetTestJSON-1569247326 tempest-VolumesGetTestJSON-1569247326-project] Calling method '.version_select at 0x7fa65e516c10>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:15.396649 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e6cd5ba6-2cac-4efe-8513-7df43b7c8abb tempest-VolumesGetTestJSON-1569247326 tempest-VolumesGetTestJSON-1569247326-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b7a97103-2ca0-416c-8acb-57470bc2ce38" status: 200 len: 354 microversion: 2.1 time: 0.068338 Aug 05 02:20:15.397216 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Aug 5 02:20:15 2022] GET /compute/v2.1/os-volumes/b7a97103-2ca0-416c-8acb-57470bc2ce38 => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:20:15.428353 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-64505cfa-8f96-450c-b2f1-e74944fb3474 tempest-VolumesGetTestJSON-1569247326 tempest-VolumesGetTestJSON-1569247326-project] Calling method '.version_select at 0x7fa65e54dca0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:15.568894 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-64505cfa-8f96-450c-b2f1-e74944fb3474 tempest-VolumesGetTestJSON-1569247326 tempest-VolumesGetTestJSON-1569247326-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/b7a97103-2ca0-416c-8acb-57470bc2ce38" status: 202 len: 0 microversion: 2.1 time: 0.152379 Aug 05 02:20:15.571745 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Aug 5 02:20:15 2022] DELETE /compute/v2.1/os-volumes/b7a97103-2ca0-416c-8acb-57470bc2ce38 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:20:15.585535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4bf5f36f-5c7c-48b7-9001-590e6a93c3b7 tempest-VolumesGetTestJSON-1569247326 tempest-VolumesGetTestJSON-1569247326-project] Calling method '.version_select at 0x7fa65e4b7310>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:15.681444 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4bf5f36f-5c7c-48b7-9001-590e6a93c3b7 tempest-VolumesGetTestJSON-1569247326 tempest-VolumesGetTestJSON-1569247326-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b7a97103-2ca0-416c-8acb-57470bc2ce38" status: 200 len: 353 microversion: 2.1 time: 0.106403 Aug 05 02:20:15.687817 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 3/5] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Aug 5 02:20:15 2022] GET /compute/v2.1/os-volumes/b7a97103-2ca0-416c-8acb-57470bc2ce38 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:20:15.754164 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7a2547bc-0325-4a29-bcba-051ed64149c7 tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] Calling method '.version_select at 0x7fa65e54dd30>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:15.835529 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7a2547bc-0325-4a29-bcba-051ed64149c7 tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/7987a245-a85d-41d8-81c1-dddb61279bee" status: 200 len: 350 microversion: 2.1 time: 0.086415 Aug 05 02:20:15.843144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 3/6] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Aug 5 02:20:15 2022] GET /compute/v2.1/os-volumes/7987a245-a85d-41d8-81c1-dddb61279bee => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:20:16.705024 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-73ef4052-0cd1-4684-907f-48ae5262fbb8 tempest-VolumesGetTestJSON-1569247326 tempest-VolumesGetTestJSON-1569247326-project] Calling method '.version_select at 0x7fa65e4b79d0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:16.795162 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-73ef4052-0cd1-4684-907f-48ae5262fbb8 tempest-VolumesGetTestJSON-1569247326 tempest-VolumesGetTestJSON-1569247326-project] HTTP exception thrown: Volume b7a97103-2ca0-416c-8acb-57470bc2ce38 could not be found. Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-73ef4052-0cd1-4684-907f-48ae5262fbb8 tempest-VolumesGetTestJSON-1569247326 tempest-VolumesGetTestJSON-1569247326-project] Request method failure captured: Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/os-volumes/b7a97103-2ca0-416c-8acb-57470bc2ce38 HTTP/1.1 Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5bVEDd0DdzWGmAYol0K1ua1hTrnghmcou8OlN1gSpCntxKnvxS_1TfNwb3oi_hriuhvXvDO1DELbOIcKCbCYAYRyspp8J_ROCaiBA776J2VnAOlAUYusu8ILAccTqXChQcOuqHzo8k0CQ5hPaIY70PRozMDxFXEJ0sc6BWE2uKqCI Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: 0207e89d12a14539bead80f6312f93fc Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesGetTestJSON-1569247326 Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:20:16.808159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:20:16.810990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0207e89d12a14539bead80f6312f93fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0207e89d12a14539bead80f6312f93fc", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0207e89d12a14539bead80f6312f93fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0207e89d12a14539bead80f6312f93fc"}]}] Aug 05 02:20:16.810990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesGetTestJSON-1569247326 Aug 05 02:20:16.810990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 0207e89d12a14539bead80f6312f93fc Aug 05 02:20:16.810990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesGetTestJSON-1569247326 Aug 05 02:20:16.810990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesGetTestJSON-1569247326-project Aug 05 02:20:16.810990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:20:16.810990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:20:16.810990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 729190451d35466ba0385522d165a895 Aug 05 02:20:16.810990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesGetTestJSON-1569247326-project Aug 05 02:20:16.810990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: Aug 05 02:20:16.810990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Volume b7a97103-2ca0-416c-8acb-57470bc2ce38 could not be found. Aug 05 02:20:16.810990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': 'b7a97103-2ca0-416c-8acb-57470bc2ce38'} Aug 05 02:20:16.810990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7a97103-2ca0-416c-8acb-57470bc2ce38 could not be found. (HTTP 404) (Request-ID: req-f35783e5-f258-4850-afcd-dd3f559c054b) Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:20:16.881111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 02:20:16.894384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7a97103-2ca0-416c-8acb-57470bc2ce38 could not be found. Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 02:20:16.896247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:20:16.898235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7a97103-2ca0-416c-8acb-57470bc2ce38 could not be found. Aug 05 02:20:16.898235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:20:16.898235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:20:16.898235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:20:16.898235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:20:16.898235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:20:16.898235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:20:16.898235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:20:16.898235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:20:16.898235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7a97103-2ca0-416c-8acb-57470bc2ce38 could not be found. Aug 05 02:20:16.898235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:20:16.898235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-73ef4052-0cd1-4684-907f-48ae5262fbb8 tempest-VolumesGetTestJSON-1569247326 tempest-VolumesGetTestJSON-1569247326-project] Returning 404 to user: Volume b7a97103-2ca0-416c-8acb-57470bc2ce38 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:20:16.898235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-73ef4052-0cd1-4684-907f-48ae5262fbb8 tempest-VolumesGetTestJSON-1569247326 tempest-VolumesGetTestJSON-1569247326-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b7a97103-2ca0-416c-8acb-57470bc2ce38" status: 404 len: 109 microversion: 2.1 time: 0.153724 Aug 05 02:20:16.898235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Aug 5 02:20:16 2022] GET /compute/v2.1/os-volumes/b7a97103-2ca0-416c-8acb-57470bc2ce38 => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:20:17.615498 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-790f974a-3edd-4b90-97f5-1a43573e6757 tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] Calling method '.version_select at 0x7fa65e49e4c0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:17.726273 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-790f974a-3edd-4b90-97f5-1a43573e6757 tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/919983aa-c987-45eb-9556-65b886f43c8b" status: 200 len: 351 microversion: 2.1 time: 0.115305 Aug 05 02:20:17.727432 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Aug 5 02:20:17 2022] GET /compute/v2.1/os-volumes/919983aa-c987-45eb-9556-65b886f43c8b => generated 351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:20:19.650620 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-34785454-431f-4e28-a5bb-937ce11fd22c tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] Calling method '.version_select at 0x7fa65e41b3a0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:20.019563 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-34785454-431f-4e28-a5bb-937ce11fd22c tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/5b01f571-7b70-44eb-a178-c4aa44ad7edf" status: 200 len: 350 microversion: 2.1 time: 0.378712 Aug 05 02:20:20.020165 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 5/9] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Aug 5 02:20:19 2022] GET /compute/v2.1/os-volumes/5b01f571-7b70-44eb-a178-c4aa44ad7edf => generated 350 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:20:20.034111 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-80fc3b50-c095-4d10-bfab-9752fb7d634d tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] Calling method '.version_select at 0x7fa65e49ea60>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:20.438786 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-80fc3b50-c095-4d10-bfab-9752fb7d634d tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.409234 Aug 05 02:20:20.440478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 5/10] 10.222.0.15 () {58 vars in 1134 bytes} [Fri Aug 5 02:20:20 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:20.458987 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0d69da50-620d-46c0-9422-d8f29c01dc24 tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] Calling method '.version_select at 0x7fa65e41ba60>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:20.598899 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0d69da50-620d-46c0-9422-d8f29c01dc24 tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.147335 Aug 05 02:20:20.602052 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 6/11] 10.222.0.15 () {58 vars in 1149 bytes} [Fri Aug 5 02:20:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:20:20.619846 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0688d7be-7873-4cea-9ae1-de55cf329e36 tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] Calling method '.version_select at 0x7fa65e49eaf0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:20.896009 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0688d7be-7873-4cea-9ae1-de55cf329e36 tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.282572 Aug 05 02:20:20.898198 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1134 bytes} [Fri Aug 5 02:20:20 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:20.921341 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8324f953-60a1-47aa-969d-0cb1041e34d3 tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] Calling method '.version_select at 0x7fa65e41b430>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:21.233938 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8324f953-60a1-47aa-969d-0cb1041e34d3 tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.322789 Aug 05 02:20:21.237705 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1167 bytes} [Fri Aug 5 02:20:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:20:21.247476 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-709540ad-afbe-46cb-9d19-ca86bb47b042 tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] Calling method '.version_select at 0x7fa65e4a4dc0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:21.469397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-709540ad-afbe-46cb-9d19-ca86bb47b042 tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.225544 Aug 05 02:20:21.470184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 7/14] 10.222.0.15 () {58 vars in 1170 bytes} [Fri Aug 5 02:20:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:20:21.490535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-249fde22-8322-497d-97a8-e533ddce5e7f tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] Calling method '.version_select at 0x7fa65e41fdc0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:21.713481 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-249fde22-8322-497d-97a8-e533ddce5e7f tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.232921 Aug 05 02:20:21.714451 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 8/15] 10.222.0.15 () {58 vars in 1155 bytes} [Fri Aug 5 02:20:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:21.728934 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-75f4e54b-3949-443f-a386-f72965fffa78 tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] Calling method '.version_select at 0x7fa65e4a4940>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:21.952216 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-75f4e54b-3949-443f-a386-f72965fffa78 tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.227435 Aug 05 02:20:21.952901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1188 bytes} [Fri Aug 5 02:20:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:20:21.968656 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d68327ad-eed8-432c-ba3e-675cf7a864cf tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] Calling method '.version_select at 0x7fa65e427040>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:22.214202 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d68327ad-eed8-432c-ba3e-675cf7a864cf tempest-VolumesTestJSON-590919216 tempest-VolumesTestJSON-590919216-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.252035 Aug 05 02:20:22.215260 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 9/17] 10.222.0.15 () {58 vars in 1155 bytes} [Fri Aug 5 02:20:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:25.872395 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-136f6272-fae1-4b8c-b103-7844f60fe317 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Action: 'create', calling method: .version_select at 0x7fa65e54db80>, body: {"keypair": {"name": "tempest-keypair-1211629349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCL4nvKX61jwIqt7yo1TdQrhOYI+J1LoffkTmaTvudHuLBTtdx0uEF4SUEUpIgXHD2QGOB4i1Q493+FXTizRs/nGxX1lT2hVrzZg4edhq/w3nfjCxHfV3MaMIJV1I6a5Zw=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:20:26.060102 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-136f6272-fae1-4b8c-b103-7844f60fe317 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Getting quotas for project ad6a220b99d94a648150476bf0a01e50. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:20:26.084591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-136f6272-fae1-4b8c-b103-7844f60fe317 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Getting quotas for user 600f51be8202427fb3691db566ed2ff2 and project ad6a220b99d94a648150476bf0a01e50. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:20:26.197615 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-136f6272-fae1-4b8c-b103-7844f60fe317 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.592898 Aug 05 02:20:26.198547 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 9/18] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Aug 5 02:20:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:20:28.601567 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ad64fbe9-7c71-4a75-973b-64988b90645e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Action: 'create', calling method: .version_select at 0x7fa65e41fee0>, body: {"keypair": {"name": "tempest-keypair-319549946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTs4qPPUiXdF3wLy8gsafG9qT4NoxVRHzgY1wKXeVdSbrRszTwrco1wd2ocK25mSc0dOKeLzFQEKnsp4lcoWKfx9OqwetfC22znxsttiBfRN8bjOn0j0kwEiLpbLYyEPQ=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:20:28.790068 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-ad64fbe9-7c71-4a75-973b-64988b90645e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Getting quotas for project ce1ac0db26e648bba79191b3ad8a260b. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:20:28.808433 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-ad64fbe9-7c71-4a75-973b-64988b90645e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Getting quotas for user 64280d0c3da14f329b6fc21228d92288 and project ce1ac0db26e648bba79191b3ad8a260b. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:20:28.952349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ad64fbe9-7c71-4a75-973b-64988b90645e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.627070 Aug 05 02:20:28.959907 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 10/19] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Aug 5 02:20:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:20:31.764006 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1897794538", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:20:32.053842 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] validate_networks() for [('9bc7c284-9f26-422a-ac52-0cd8c7ee2353', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:20:35.012989 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-772f7223-79ae-470c-bc92-1b355d5e8073 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Action: 'create', calling method: .version_select at 0x7fa65e3eea60>, body: {"keypair": {"name": "tempest-keypair-1660420522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzDma3HlEDW1W43WeoApySqWVoAdabKbvKwveZIroVtv9XuAgnRWoDzjxDrhFf8ybRqItArU8go1Z8uNVQuTyFfEGyCPMHsLYxk9dR6njbcfk39+2opnLDuRHygYHNpXA=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:20:35.046660 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-772f7223-79ae-470c-bc92-1b355d5e8073 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Getting quotas for project 6873a99b9878495895acb21ed2133bb6. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:20:35.051694 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-772f7223-79ae-470c-bc92-1b355d5e8073 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Getting quotas for user 3d47613c7085460da42e2179625b3f16 and project 6873a99b9878495895acb21ed2133bb6. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:20:35.137838 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-772f7223-79ae-470c-bc92-1b355d5e8073 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.751459 Aug 05 02:20:35.138503 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 11/20] 10.222.0.15 () {62 vars in 1200 bytes} [Fri Aug 5 02:20:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 753 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 05 02:20:35.162606 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1045982140", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "528bd4e2-8ce2-403c-8a20-be166348ecb8"}], "security_groups": [{"name": "tempest-securitygroup--1734472410"}], "key_name": "tempest-keypair-1211629349", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:20:35.730650 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] validate_networks() for [('528bd4e2-8ce2-403c-8a20-be166348ecb8', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:20:36.079014 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:20:36.079544 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:20:36.079898 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:20:36.080306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:20:36.081235 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:20:36.105750 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:36.106670 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:36.109946 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:36.115143 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:36.118585 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:36.119303 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:36.226130 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Getting quotas for project 00eaaf2e12844123996e26c1827d80b2. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:20:36.254893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Getting quotas for user 5bf84408a3984972a5bb68a3117c0501 and project 00eaaf2e12844123996e26c1827d80b2. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:20:36.312136 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:20:36.319769 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:20:36.484180 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-13fa7165-6878-4139-87cc-d0311df637e2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.075375 Aug 05 02:20:36.494585 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 10/21] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:20:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 5086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:20:36.930866 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1704998430", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452", "networks": [{"uuid": "8fc175c4-e4aa-4f2a-b5dc-e58b6fda1d1e"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:20:37.021790 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] validate_networks() for [('8fc175c4-e4aa-4f2a-b5dc-e58b6fda1d1e', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:20:38.499796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:20:38.500275 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:20:38.500869 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:20:38.501341 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:20:38.502049 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:20:38.522845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:38.523550 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:38.523992 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:38.527983 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:38.529011 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:38.531365 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:38.613264 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Getting quotas for project ad6a220b99d94a648150476bf0a01e50. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:20:38.626086 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Getting quotas for user 600f51be8202427fb3691db566ed2ff2 and project ad6a220b99d94a648150476bf0a01e50. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:20:38.644700 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:20:38.647976 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:20:38.798801 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-43fecba6-ec77-4ec4-8c82-1f84fc5e5b79 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.648513 Aug 05 02:20:38.799921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 12/22] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:20:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 3650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:20:38.810229 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6873b4c7-a264-4596-beeb-c9b643d4bcfd tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:38.811819 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6873b4c7-a264-4596-beeb-c9b643d4bcfd tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:38.835881 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:20:38.836377 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:20:38.836953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:20:38.837457 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:20:38.837964 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:20:38.861144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:38.865080 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:38.865794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:38.867030 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:38.876774 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:38.878493 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:38.956348 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Getting quotas for project 5550d9709b98404290936885c7bbb16d. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:20:38.987943 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Getting quotas for user 4e39a7be17b94c9c9dfb9ac1599a0052 and project 5550d9709b98404290936885c7bbb16d. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:20:39.003701 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:20:39.026014 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:20:39.134801 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-759b2521-bf32-48b0-a8d8-dc4149e02fc7 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.638063 Aug 05 02:20:39.137726 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 11/23] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:20:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:20:39.159504 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-863155816", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf7849d5-61da-44b5-8e65-8d7323d12692"}], "security_groups": [{"name": "tempest-securitygroup--363854875"}], "key_name": "tempest-keypair-319549946", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:20:39.504220 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] validate_networks() for [('bf7849d5-61da-44b5-8e65-8d7323d12692', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:20:40.098217 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6873b4c7-a264-4596-beeb-c9b643d4bcfd tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:40.138210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6873b4c7-a264-4596-beeb-c9b643d4bcfd tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1222 microversion: 2.1 time: 1.334936 Aug 05 02:20:40.160208 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 13/24] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:38 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1222 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:40.197500 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4f67521d-b4da-488b-a794-7d4c89c20050 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:40.198395 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4f67521d-b4da-488b-a794-7d4c89c20050 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:40.407687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4f67521d-b4da-488b-a794-7d4c89c20050 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:40.438473 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4f67521d-b4da-488b-a794-7d4c89c20050 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1242 microversion: 2.1 time: 0.253606 Aug 05 02:20:40.452361 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 14/25] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:40 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1242 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:40.458493 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1ccafda7-40f8-452b-9e41-9bed23914077 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:40.461469 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1ccafda7-40f8-452b-9e41-9bed23914077 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:40.694758 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:20:40.695299 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:20:40.696372 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:20:40.696999 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:20:40.697424 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:20:40.724717 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1ccafda7-40f8-452b-9e41-9bed23914077 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:40.731735 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:40.733891 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1ccafda7-40f8-452b-9e41-9bed23914077 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1215 microversion: 2.1 time: 0.293201 Aug 05 02:20:40.737299 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:40.738040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:40.739934 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:40.740708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:40.741391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:40.745349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 15/26] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:40 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1215 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:40.755362 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-50736266", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:20:40.802937 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Getting quotas for project ce1ac0db26e648bba79191b3ad8a260b. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:20:40.816849 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Getting quotas for user 64280d0c3da14f329b6fc21228d92288 and project ce1ac0db26e648bba79191b3ad8a260b. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:20:40.898229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:20:40.901408 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:20:40.916432 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] validate_networks() for [('9bc7c284-9f26-422a-ac52-0cd8c7ee2353', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:20:41.141439 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-77d2d46a-9b81-497e-b1a0-90395874d514 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.999668 Aug 05 02:20:41.142101 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 12/27] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:20:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 2004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:20:41.164449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-65bec105-8782-4824-89d8-277003002084 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:41.165903 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-65bec105-8782-4824-89d8-277003002084 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:41.427141 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-65bec105-8782-4824-89d8-277003002084 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:41.459515 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-65bec105-8782-4824-89d8-277003002084 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1236 microversion: 2.1 time: 0.308097 Aug 05 02:20:41.477797 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 13/28] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:41 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1236 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:41.504569 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-788f3aca-8fbe-43d9-86db-15e55152d3f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:41.505207 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-788f3aca-8fbe-43d9-86db-15e55152d3f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:41.520344 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-788f3aca-8fbe-43d9-86db-15e55152d3f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:41.522523 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-788f3aca-8fbe-43d9-86db-15e55152d3f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:41.522647 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-788f3aca-8fbe-43d9-86db-15e55152d3f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:41.523618 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-788f3aca-8fbe-43d9-86db-15e55152d3f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:41.524079 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-788f3aca-8fbe-43d9-86db-15e55152d3f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:41.524824 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-788f3aca-8fbe-43d9-86db-15e55152d3f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:42.009451 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-788f3aca-8fbe-43d9-86db-15e55152d3f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:42.023493 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-788f3aca-8fbe-43d9-86db-15e55152d3f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1246 microversion: 2.1 time: 0.541144 Aug 05 02:20:42.024583 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 14/29] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:41 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1246 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:42.029986 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4798df6e-e928-47f8-9f97-c29f73b32b45 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:42.030794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4798df6e-e928-47f8-9f97-c29f73b32b45 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:42.052093 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4798df6e-e928-47f8-9f97-c29f73b32b45 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:42.052624 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4798df6e-e928-47f8-9f97-c29f73b32b45 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:42.053066 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4798df6e-e928-47f8-9f97-c29f73b32b45 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:42.058283 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4798df6e-e928-47f8-9f97-c29f73b32b45 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:42.058851 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4798df6e-e928-47f8-9f97-c29f73b32b45 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:42.062327 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4798df6e-e928-47f8-9f97-c29f73b32b45 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:42.089161 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:20:42.089670 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:20:42.090115 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:20:42.090555 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:20:42.090985 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:20:42.104706 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:42.105210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:42.108131 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:42.109163 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:42.109638 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:42.110157 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:42.147125 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Getting quotas for project 00eaaf2e12844123996e26c1827d80b2. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:20:42.156119 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Getting quotas for user 5bf84408a3984972a5bb68a3117c0501 and project 00eaaf2e12844123996e26c1827d80b2. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:20:42.175112 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:20:42.183285 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:20:42.249017 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4798df6e-e928-47f8-9f97-c29f73b32b45 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:42.273443 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4798df6e-e928-47f8-9f97-c29f73b32b45 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1211 microversion: 2.1 time: 0.231667 Aug 05 02:20:42.274379 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 15/30] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:42 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1211 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:42.296021 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fa2a82c2-c754-4ecb-b736-83a02d5b0cb9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.547805 Aug 05 02:20:42.298693 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 16/31] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:20:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:20:42.309647 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bca3a9d7-a3ec-4a81-b9b2-d96a05b647d6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:42.310927 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bca3a9d7-a3ec-4a81-b9b2-d96a05b647d6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:42.334812 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-849162347", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21fc4037-98aa-44e1-a7ca-1e86cf11ad68"}], "security_groups": [{"name": "tempest-securitygroup--138574673"}], "key_name": "tempest-keypair-1660420522", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:20:42.481385 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bca3a9d7-a3ec-4a81-b9b2-d96a05b647d6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:42.490682 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bca3a9d7-a3ec-4a81-b9b2-d96a05b647d6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1220 microversion: 2.1 time: 0.184734 Aug 05 02:20:42.491267 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 16/32] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:42 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1220 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:42.501387 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] validate_networks() for [('21fc4037-98aa-44e1-a7ca-1e86cf11ad68', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:20:42.513085 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2a88b256-bb28-4bf8-8201-0cb21f4402f5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:42.514264 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2a88b256-bb28-4bf8-8201-0cb21f4402f5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:42.554828 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a88b256-bb28-4bf8-8201-0cb21f4402f5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:42.559246 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a88b256-bb28-4bf8-8201-0cb21f4402f5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:42.561822 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a88b256-bb28-4bf8-8201-0cb21f4402f5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:42.562742 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a88b256-bb28-4bf8-8201-0cb21f4402f5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:42.567230 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a88b256-bb28-4bf8-8201-0cb21f4402f5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:42.567866 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a88b256-bb28-4bf8-8201-0cb21f4402f5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:42.708472 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2a88b256-bb28-4bf8-8201-0cb21f4402f5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:42.724203 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2a88b256-bb28-4bf8-8201-0cb21f4402f5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1240 microversion: 2.1 time: 0.214650 Aug 05 02:20:42.725402 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 17/33] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:42 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1240 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:43.048992 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-446b3ed9-f623-4bf5-8b21-b7ca6a152e75 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:43.049834 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-446b3ed9-f623-4bf5-8b21-b7ca6a152e75 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:43.073178 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-446b3ed9-f623-4bf5-8b21-b7ca6a152e75 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:43.075181 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-446b3ed9-f623-4bf5-8b21-b7ca6a152e75 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:43.075979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-446b3ed9-f623-4bf5-8b21-b7ca6a152e75 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:43.078199 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-446b3ed9-f623-4bf5-8b21-b7ca6a152e75 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:43.078686 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-446b3ed9-f623-4bf5-8b21-b7ca6a152e75 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:43.081378 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-446b3ed9-f623-4bf5-8b21-b7ca6a152e75 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:43.149513 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:20:43.151245 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:20:43.151859 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:20:43.152489 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:20:43.153215 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:20:43.170265 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:43.170992 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:43.172305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:43.173809 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:43.174454 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:43.175440 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:43.183193 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-446b3ed9-f623-4bf5-8b21-b7ca6a152e75 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:43.195042 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-446b3ed9-f623-4bf5-8b21-b7ca6a152e75 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1246 microversion: 2.1 time: 0.150589 Aug 05 02:20:43.196245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 18/34] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:43 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1246 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:43.203191 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Getting quotas for project 6873a99b9878495895acb21ed2133bb6. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:20:43.207769 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Getting quotas for user 3d47613c7085460da42e2179625b3f16 and project 6873a99b9878495895acb21ed2133bb6. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:20:43.220853 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:20:43.223371 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:20:43.273808 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0afa67dd-f20c-4ccb-9192-a52e345c216c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.944048 Aug 05 02:20:43.274992 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 17/35] 10.222.0.15 () {62 vars in 1188 bytes} [Fri Aug 5 02:20:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 05 02:20:43.286155 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-be944dc0-a5a7-4a66-935c-fad01a6c6cc4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:43.286692 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-be944dc0-a5a7-4a66-935c-fad01a6c6cc4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:43.303281 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d8e2d708-3f1f-41fc-ad47-5faef46794e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:43.304224 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d8e2d708-3f1f-41fc-ad47-5faef46794e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:43.312886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8e2d708-3f1f-41fc-ad47-5faef46794e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:43.313545 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8e2d708-3f1f-41fc-ad47-5faef46794e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:43.314288 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8e2d708-3f1f-41fc-ad47-5faef46794e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:43.315004 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8e2d708-3f1f-41fc-ad47-5faef46794e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:43.315463 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8e2d708-3f1f-41fc-ad47-5faef46794e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:43.316068 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8e2d708-3f1f-41fc-ad47-5faef46794e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:43.387632 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-be944dc0-a5a7-4a66-935c-fad01a6c6cc4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:43.397884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-be944dc0-a5a7-4a66-935c-fad01a6c6cc4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:43.403080 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-be944dc0-a5a7-4a66-935c-fad01a6c6cc4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:43.406600 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-be944dc0-a5a7-4a66-935c-fad01a6c6cc4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1281 microversion: 2.20 time: 0.123834 Aug 05 02:20:43.407194 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 19/36] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:20:43 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1281 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:20:43.492707 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d8e2d708-3f1f-41fc-ad47-5faef46794e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:43.511548 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d8e2d708-3f1f-41fc-ad47-5faef46794e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1211 microversion: 2.1 time: 0.211503 Aug 05 02:20:43.511687 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3a9e869d-dc09-44dc-89a1-1c691971de05 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:43.512491 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 18/37] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:43 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1211 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:43.515134 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3a9e869d-dc09-44dc-89a1-1c691971de05 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:43.524964 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a9e869d-dc09-44dc-89a1-1c691971de05 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:43.525583 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a9e869d-dc09-44dc-89a1-1c691971de05 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:43.527376 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a9e869d-dc09-44dc-89a1-1c691971de05 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:43.528299 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a9e869d-dc09-44dc-89a1-1c691971de05 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:43.531780 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a9e869d-dc09-44dc-89a1-1c691971de05 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:43.532652 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a9e869d-dc09-44dc-89a1-1c691971de05 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:43.625286 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3a9e869d-dc09-44dc-89a1-1c691971de05 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:43.632896 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3a9e869d-dc09-44dc-89a1-1c691971de05 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1224 microversion: 2.1 time: 0.125374 Aug 05 02:20:43.633463 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 20/38] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:43 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1224 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:43.758485 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-da7833f2-1f5e-4a91-ae37-fc63019e93f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:43.762481 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-da7833f2-1f5e-4a91-ae37-fc63019e93f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:43.781857 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da7833f2-1f5e-4a91-ae37-fc63019e93f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:43.782660 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da7833f2-1f5e-4a91-ae37-fc63019e93f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:43.783250 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da7833f2-1f5e-4a91-ae37-fc63019e93f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:43.784602 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da7833f2-1f5e-4a91-ae37-fc63019e93f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:43.785277 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da7833f2-1f5e-4a91-ae37-fc63019e93f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:43.785751 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-da7833f2-1f5e-4a91-ae37-fc63019e93f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:43.888849 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-da7833f2-1f5e-4a91-ae37-fc63019e93f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:43.898846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-da7833f2-1f5e-4a91-ae37-fc63019e93f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1240 microversion: 2.1 time: 0.152986 Aug 05 02:20:43.899368 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 19/39] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:43 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1240 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:44.215099 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-347132d4-2b4f-43f5-a097-4747dbe623f3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:44.215791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-347132d4-2b4f-43f5-a097-4747dbe623f3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:44.229942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-347132d4-2b4f-43f5-a097-4747dbe623f3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:44.230364 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-347132d4-2b4f-43f5-a097-4747dbe623f3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:44.231111 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-347132d4-2b4f-43f5-a097-4747dbe623f3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:44.232112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-347132d4-2b4f-43f5-a097-4747dbe623f3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:44.232977 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-347132d4-2b4f-43f5-a097-4747dbe623f3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:44.233623 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-347132d4-2b4f-43f5-a097-4747dbe623f3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:44.326594 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-347132d4-2b4f-43f5-a097-4747dbe623f3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:44.335403 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-347132d4-2b4f-43f5-a097-4747dbe623f3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1246 microversion: 2.1 time: 0.123860 Aug 05 02:20:44.348749 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 21/40] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:44 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1246 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:44.436012 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f84f758b-f2db-4b99-bc96-4fb76f7e6564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:44.441070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f84f758b-f2db-4b99-bc96-4fb76f7e6564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:44.449600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f84f758b-f2db-4b99-bc96-4fb76f7e6564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:44.450334 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f84f758b-f2db-4b99-bc96-4fb76f7e6564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:44.451742 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f84f758b-f2db-4b99-bc96-4fb76f7e6564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:44.452733 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f84f758b-f2db-4b99-bc96-4fb76f7e6564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:44.453371 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f84f758b-f2db-4b99-bc96-4fb76f7e6564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:44.454044 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f84f758b-f2db-4b99-bc96-4fb76f7e6564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:44.536682 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-336638ab-8304-4eb8-a8b2-6deb1c9876a8 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:44.537429 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-336638ab-8304-4eb8-a8b2-6deb1c9876a8 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:44.550536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f84f758b-f2db-4b99-bc96-4fb76f7e6564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:44.561210 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-336638ab-8304-4eb8-a8b2-6deb1c9876a8 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:44.562026 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-336638ab-8304-4eb8-a8b2-6deb1c9876a8 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:44.563574 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-336638ab-8304-4eb8-a8b2-6deb1c9876a8 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:44.563701 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f84f758b-f2db-4b99-bc96-4fb76f7e6564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:44.564579 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-336638ab-8304-4eb8-a8b2-6deb1c9876a8 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:44.565156 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-336638ab-8304-4eb8-a8b2-6deb1c9876a8 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:44.565684 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-336638ab-8304-4eb8-a8b2-6deb1c9876a8 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:44.566210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f84f758b-f2db-4b99-bc96-4fb76f7e6564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:44.567512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f84f758b-f2db-4b99-bc96-4fb76f7e6564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1285 microversion: 2.20 time: 0.140223 Aug 05 02:20:44.568616 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:20:44 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:20:44.650646 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-336638ab-8304-4eb8-a8b2-6deb1c9876a8 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:44.659067 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7095ee19-ac64-4320-a3d8-e49840c65595 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:44.659716 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7095ee19-ac64-4320-a3d8-e49840c65595 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:44.659978 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-336638ab-8304-4eb8-a8b2-6deb1c9876a8 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1211 microversion: 2.1 time: 0.128666 Aug 05 02:20:44.661848 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 22/42] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:44 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1211 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:44.670893 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7095ee19-ac64-4320-a3d8-e49840c65595 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:44.671818 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7095ee19-ac64-4320-a3d8-e49840c65595 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:44.672523 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7095ee19-ac64-4320-a3d8-e49840c65595 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:44.674140 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7095ee19-ac64-4320-a3d8-e49840c65595 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:44.674754 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7095ee19-ac64-4320-a3d8-e49840c65595 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:44.675491 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7095ee19-ac64-4320-a3d8-e49840c65595 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:44.925105 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-85bee826-c785-47ea-a74a-28f5b143496e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:44.925736 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-85bee826-c785-47ea-a74a-28f5b143496e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:44.941538 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7095ee19-ac64-4320-a3d8-e49840c65595 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:44.941711 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85bee826-c785-47ea-a74a-28f5b143496e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:44.942120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85bee826-c785-47ea-a74a-28f5b143496e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:44.945602 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85bee826-c785-47ea-a74a-28f5b143496e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:44.946362 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85bee826-c785-47ea-a74a-28f5b143496e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:44.946821 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85bee826-c785-47ea-a74a-28f5b143496e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:44.947451 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85bee826-c785-47ea-a74a-28f5b143496e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:44.961867 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7095ee19-ac64-4320-a3d8-e49840c65595 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1224 microversion: 2.1 time: 0.310664 Aug 05 02:20:44.964410 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 21/43] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:44 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1224 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:20:45.045005 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-85bee826-c785-47ea-a74a-28f5b143496e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:45.055592 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-85bee826-c785-47ea-a74a-28f5b143496e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1240 microversion: 2.1 time: 0.136181 Aug 05 02:20:45.057451 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 23/44] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:44 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1240 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:20:45.356553 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3ee43fb7-e8e9-4576-82d8-0f307d6fddf4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:45.357164 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3ee43fb7-e8e9-4576-82d8-0f307d6fddf4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:45.363561 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ee43fb7-e8e9-4576-82d8-0f307d6fddf4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:45.364051 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ee43fb7-e8e9-4576-82d8-0f307d6fddf4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:45.364514 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ee43fb7-e8e9-4576-82d8-0f307d6fddf4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:45.365345 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ee43fb7-e8e9-4576-82d8-0f307d6fddf4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:45.365711 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ee43fb7-e8e9-4576-82d8-0f307d6fddf4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:45.366430 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3ee43fb7-e8e9-4576-82d8-0f307d6fddf4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:45.428159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3ee43fb7-e8e9-4576-82d8-0f307d6fddf4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:45.436050 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3ee43fb7-e8e9-4576-82d8-0f307d6fddf4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1246 microversion: 2.1 time: 0.083396 Aug 05 02:20:45.436644 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 22/45] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:45 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:45.592636 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-86ea06eb-fc1d-4a53-8c30-f8f268810989 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:45.593141 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-86ea06eb-fc1d-4a53-8c30-f8f268810989 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:45.599308 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86ea06eb-fc1d-4a53-8c30-f8f268810989 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:45.599796 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86ea06eb-fc1d-4a53-8c30-f8f268810989 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:45.600235 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86ea06eb-fc1d-4a53-8c30-f8f268810989 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:45.600956 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86ea06eb-fc1d-4a53-8c30-f8f268810989 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:45.601425 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86ea06eb-fc1d-4a53-8c30-f8f268810989 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:45.601857 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86ea06eb-fc1d-4a53-8c30-f8f268810989 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:45.661086 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-86ea06eb-fc1d-4a53-8c30-f8f268810989 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:45.668865 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-86ea06eb-fc1d-4a53-8c30-f8f268810989 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:45.671010 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-86ea06eb-fc1d-4a53-8c30-f8f268810989 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:45.672114 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-86ea06eb-fc1d-4a53-8c30-f8f268810989 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1285 microversion: 2.20 time: 0.083484 Aug 05 02:20:45.672712 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:20:45 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1285 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:20:45.680819 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-df006873-7bc4-4867-aac6-ee507170856c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:45.681426 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-df006873-7bc4-4867-aac6-ee507170856c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:45.684361 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:45.688894 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df006873-7bc4-4867-aac6-ee507170856c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:45.689380 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df006873-7bc4-4867-aac6-ee507170856c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:45.689811 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df006873-7bc4-4867-aac6-ee507170856c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:45.690493 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df006873-7bc4-4867-aac6-ee507170856c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:45.690943 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df006873-7bc4-4867-aac6-ee507170856c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:45.691361 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df006873-7bc4-4867-aac6-ee507170856c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:45.752112 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-df006873-7bc4-4867-aac6-ee507170856c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:45.759298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-df006873-7bc4-4867-aac6-ee507170856c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1211 microversion: 2.1 time: 0.082278 Aug 05 02:20:45.759859 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 23/47] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:45 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:45.985207 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-08240daf-4f8b-4400-b542-d7a77e22755d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:45.985812 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-08240daf-4f8b-4400-b542-d7a77e22755d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:45.991682 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08240daf-4f8b-4400-b542-d7a77e22755d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:45.992155 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08240daf-4f8b-4400-b542-d7a77e22755d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:45.992613 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08240daf-4f8b-4400-b542-d7a77e22755d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:45.993358 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08240daf-4f8b-4400-b542-d7a77e22755d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:45.993808 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08240daf-4f8b-4400-b542-d7a77e22755d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:45.994228 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08240daf-4f8b-4400-b542-d7a77e22755d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:46.059412 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-08240daf-4f8b-4400-b542-d7a77e22755d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:46.074836 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-08240daf-4f8b-4400-b542-d7a77e22755d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1224 microversion: 2.1 time: 0.093849 Aug 05 02:20:46.075650 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 25/48] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:45 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:46.078198 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7f3d1267-bc7b-41e9-8f07-2f716576541e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:46.078820 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7f3d1267-bc7b-41e9-8f07-2f716576541e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:46.091859 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f3d1267-bc7b-41e9-8f07-2f716576541e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:46.092454 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f3d1267-bc7b-41e9-8f07-2f716576541e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:46.092908 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f3d1267-bc7b-41e9-8f07-2f716576541e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:46.093717 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f3d1267-bc7b-41e9-8f07-2f716576541e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:46.094191 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f3d1267-bc7b-41e9-8f07-2f716576541e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:46.094613 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f3d1267-bc7b-41e9-8f07-2f716576541e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:46.155858 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7f3d1267-bc7b-41e9-8f07-2f716576541e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:46.163164 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7f3d1267-bc7b-41e9-8f07-2f716576541e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1240 microversion: 2.1 time: 0.090452 Aug 05 02:20:46.163733 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 24/49] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:46 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:46.456920 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ddc13131-249f-4968-bfd7-a17ad5401a63 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:46.457599 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ddc13131-249f-4968-bfd7-a17ad5401a63 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:46.463747 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ddc13131-249f-4968-bfd7-a17ad5401a63 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:46.464229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ddc13131-249f-4968-bfd7-a17ad5401a63 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:46.464724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ddc13131-249f-4968-bfd7-a17ad5401a63 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:46.465415 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ddc13131-249f-4968-bfd7-a17ad5401a63 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:46.466000 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ddc13131-249f-4968-bfd7-a17ad5401a63 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:46.466612 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ddc13131-249f-4968-bfd7-a17ad5401a63 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:46.530735 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ddc13131-249f-4968-bfd7-a17ad5401a63 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:46.538078 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ddc13131-249f-4968-bfd7-a17ad5401a63 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1246 microversion: 2.1 time: 0.085211 Aug 05 02:20:46.538639 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 26/50] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:46 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:46.695489 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e26c8d1f-cab8-4ac3-9fd1-ea5089a1957a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:46.696093 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e26c8d1f-cab8-4ac3-9fd1-ea5089a1957a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:46.702423 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e26c8d1f-cab8-4ac3-9fd1-ea5089a1957a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:46.702907 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e26c8d1f-cab8-4ac3-9fd1-ea5089a1957a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:46.703342 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e26c8d1f-cab8-4ac3-9fd1-ea5089a1957a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:46.704041 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e26c8d1f-cab8-4ac3-9fd1-ea5089a1957a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:46.704537 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e26c8d1f-cab8-4ac3-9fd1-ea5089a1957a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:46.704973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e26c8d1f-cab8-4ac3-9fd1-ea5089a1957a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:46.771701 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e26c8d1f-cab8-4ac3-9fd1-ea5089a1957a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:46.784836 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e26c8d1f-cab8-4ac3-9fd1-ea5089a1957a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:46.786466 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e26c8d1f-cab8-4ac3-9fd1-ea5089a1957a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:46.788207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e26c8d1f-cab8-4ac3-9fd1-ea5089a1957a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1277 microversion: 2.20 time: 0.096546 Aug 05 02:20:46.792378 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:20:46 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:20:46.796196 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-467b8f8a-1fa0-42d4-903a-e183f9672fb0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:46.799435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-467b8f8a-1fa0-42d4-903a-e183f9672fb0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:46.811974 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-467b8f8a-1fa0-42d4-903a-e183f9672fb0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:46.812729 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-467b8f8a-1fa0-42d4-903a-e183f9672fb0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:46.813371 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-467b8f8a-1fa0-42d4-903a-e183f9672fb0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:46.814627 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-467b8f8a-1fa0-42d4-903a-e183f9672fb0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:46.815603 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-467b8f8a-1fa0-42d4-903a-e183f9672fb0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:46.816231 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-467b8f8a-1fa0-42d4-903a-e183f9672fb0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:46.893932 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-467b8f8a-1fa0-42d4-903a-e183f9672fb0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:46.902412 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-467b8f8a-1fa0-42d4-903a-e183f9672fb0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1211 microversion: 2.1 time: 0.127098 Aug 05 02:20:46.903139 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 27/52] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:46 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1211 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:20:47.095962 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-558be637-94cc-43b4-80ff-96a51a27b579 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:47.097013 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-558be637-94cc-43b4-80ff-96a51a27b579 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:47.106381 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-558be637-94cc-43b4-80ff-96a51a27b579 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:47.106899 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-558be637-94cc-43b4-80ff-96a51a27b579 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:47.107509 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-558be637-94cc-43b4-80ff-96a51a27b579 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:47.108408 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-558be637-94cc-43b4-80ff-96a51a27b579 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:47.109014 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-558be637-94cc-43b4-80ff-96a51a27b579 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:47.109598 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-558be637-94cc-43b4-80ff-96a51a27b579 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:47.179542 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-558be637-94cc-43b4-80ff-96a51a27b579 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:47.182870 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b79a9d21-e897-4675-855a-cc3eabf85951 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:47.183477 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b79a9d21-e897-4675-855a-cc3eabf85951 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:47.187008 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:47.187624 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-558be637-94cc-43b4-80ff-96a51a27b579 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1216 microversion: 2.1 time: 0.096548 Aug 05 02:20:47.188188 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 26/53] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:47 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1216 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:47.190681 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b79a9d21-e897-4675-855a-cc3eabf85951 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:47.191164 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b79a9d21-e897-4675-855a-cc3eabf85951 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:47.191601 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b79a9d21-e897-4675-855a-cc3eabf85951 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:47.192290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b79a9d21-e897-4675-855a-cc3eabf85951 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:47.192773 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b79a9d21-e897-4675-855a-cc3eabf85951 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:47.193194 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b79a9d21-e897-4675-855a-cc3eabf85951 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:47.254625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b79a9d21-e897-4675-855a-cc3eabf85951 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:47.261844 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b79a9d21-e897-4675-855a-cc3eabf85951 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1232 microversion: 2.1 time: 0.082758 Aug 05 02:20:47.262413 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 28/54] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:47 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1232 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:47.559144 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b3c7cb43-0a11-4d59-ab2a-6aac4fdc3b47 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:47.560153 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b3c7cb43-0a11-4d59-ab2a-6aac4fdc3b47 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:47.566540 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b3c7cb43-0a11-4d59-ab2a-6aac4fdc3b47 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:47.567181 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b3c7cb43-0a11-4d59-ab2a-6aac4fdc3b47 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:47.570206 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b3c7cb43-0a11-4d59-ab2a-6aac4fdc3b47 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:47.571109 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b3c7cb43-0a11-4d59-ab2a-6aac4fdc3b47 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:47.571863 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b3c7cb43-0a11-4d59-ab2a-6aac4fdc3b47 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:47.572706 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b3c7cb43-0a11-4d59-ab2a-6aac4fdc3b47 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:47.644757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b3c7cb43-0a11-4d59-ab2a-6aac4fdc3b47 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:47.652663 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b3c7cb43-0a11-4d59-ab2a-6aac4fdc3b47 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1294 microversion: 2.1 time: 0.097069 Aug 05 02:20:47.653445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 27/55] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:47 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1294 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:47.813948 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-28b6639d-d892-42f1-9e85-06be50b5d674 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:47.814568 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-28b6639d-d892-42f1-9e85-06be50b5d674 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:47.821586 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28b6639d-d892-42f1-9e85-06be50b5d674 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:47.822237 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28b6639d-d892-42f1-9e85-06be50b5d674 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:47.822675 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28b6639d-d892-42f1-9e85-06be50b5d674 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:47.823414 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28b6639d-d892-42f1-9e85-06be50b5d674 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:47.823931 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28b6639d-d892-42f1-9e85-06be50b5d674 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:47.824613 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28b6639d-d892-42f1-9e85-06be50b5d674 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:47.926868 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c7fc9a9d-24c7-4322-9051-d1eebba69866 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:47.927471 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c7fc9a9d-24c7-4322-9051-d1eebba69866 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:47.931264 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-28b6639d-d892-42f1-9e85-06be50b5d674 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:47.934946 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7fc9a9d-24c7-4322-9051-d1eebba69866 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:47.935655 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7fc9a9d-24c7-4322-9051-d1eebba69866 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:47.936072 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7fc9a9d-24c7-4322-9051-d1eebba69866 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:47.936778 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7fc9a9d-24c7-4322-9051-d1eebba69866 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:47.937221 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7fc9a9d-24c7-4322-9051-d1eebba69866 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:47.937637 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7fc9a9d-24c7-4322-9051-d1eebba69866 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:47.940588 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-28b6639d-d892-42f1-9e85-06be50b5d674 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:47.942234 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-28b6639d-d892-42f1-9e85-06be50b5d674 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:47.943276 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-28b6639d-d892-42f1-9e85-06be50b5d674 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1333 microversion: 2.20 time: 0.134380 Aug 05 02:20:47.944252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 29/56] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:20:47 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1333 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:20:48.006440 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c7fc9a9d-24c7-4322-9051-d1eebba69866 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:48.015980 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c7fc9a9d-24c7-4322-9051-d1eebba69866 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1275 microversion: 2.1 time: 0.092877 Aug 05 02:20:48.016873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 28/57] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:47 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1275 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:20:48.209050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cbc65acc-ba8d-420a-a82b-72155933131c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:48.209945 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cbc65acc-ba8d-420a-a82b-72155933131c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:48.237535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbc65acc-ba8d-420a-a82b-72155933131c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:48.241354 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbc65acc-ba8d-420a-a82b-72155933131c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:48.242987 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbc65acc-ba8d-420a-a82b-72155933131c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:48.250947 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbc65acc-ba8d-420a-a82b-72155933131c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:48.251750 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbc65acc-ba8d-420a-a82b-72155933131c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:48.254137 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbc65acc-ba8d-420a-a82b-72155933131c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:48.284732 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-42a5d130-d400-460a-9a20-37b3cd19db3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:48.285900 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-42a5d130-d400-460a-9a20-37b3cd19db3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:48.312186 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42a5d130-d400-460a-9a20-37b3cd19db3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:48.313752 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42a5d130-d400-460a-9a20-37b3cd19db3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:48.314913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42a5d130-d400-460a-9a20-37b3cd19db3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:48.316487 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42a5d130-d400-460a-9a20-37b3cd19db3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:48.319630 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42a5d130-d400-460a-9a20-37b3cd19db3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:48.322367 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42a5d130-d400-460a-9a20-37b3cd19db3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:48.454113 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-42a5d130-d400-460a-9a20-37b3cd19db3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:48.468054 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cbc65acc-ba8d-420a-a82b-72155933131c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:48.468930 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-42a5d130-d400-460a-9a20-37b3cd19db3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1288 microversion: 2.1 time: 0.187419 Aug 05 02:20:48.469683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 29/58] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:48 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1288 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:48.484897 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cbc65acc-ba8d-420a-a82b-72155933131c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1272 microversion: 2.1 time: 0.280230 Aug 05 02:20:48.487455 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 30/59] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:48 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1272 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:48.679987 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b15a1684-c3f7-43ae-9f6f-1948502e1ba9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:48.680837 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b15a1684-c3f7-43ae-9f6f-1948502e1ba9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:48.689823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b15a1684-c3f7-43ae-9f6f-1948502e1ba9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:48.715579 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b15a1684-c3f7-43ae-9f6f-1948502e1ba9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:48.716045 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b15a1684-c3f7-43ae-9f6f-1948502e1ba9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:48.718253 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b15a1684-c3f7-43ae-9f6f-1948502e1ba9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:48.718723 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b15a1684-c3f7-43ae-9f6f-1948502e1ba9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:48.719158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b15a1684-c3f7-43ae-9f6f-1948502e1ba9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:48.929673 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b15a1684-c3f7-43ae-9f6f-1948502e1ba9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:48.953260 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b15a1684-c3f7-43ae-9f6f-1948502e1ba9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1312 microversion: 2.1 time: 0.283486 Aug 05 02:20:48.975934 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 30/60] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:48 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1312 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:48.978558 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb8f0809-1a02-418d-b8fc-d8cee966da7c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:48.979365 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cb8f0809-1a02-418d-b8fc-d8cee966da7c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:49.015565 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb8f0809-1a02-418d-b8fc-d8cee966da7c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:49.017326 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb8f0809-1a02-418d-b8fc-d8cee966da7c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:49.018668 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb8f0809-1a02-418d-b8fc-d8cee966da7c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:49.021339 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb8f0809-1a02-418d-b8fc-d8cee966da7c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:49.022972 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb8f0809-1a02-418d-b8fc-d8cee966da7c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:49.024101 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb8f0809-1a02-418d-b8fc-d8cee966da7c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:49.042586 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8d6e9e12-f3b5-4fea-99bd-bed2dc85aeb2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:49.043433 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8d6e9e12-f3b5-4fea-99bd-bed2dc85aeb2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:49.059033 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d6e9e12-f3b5-4fea-99bd-bed2dc85aeb2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:49.063524 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d6e9e12-f3b5-4fea-99bd-bed2dc85aeb2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:49.064722 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d6e9e12-f3b5-4fea-99bd-bed2dc85aeb2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:49.068819 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d6e9e12-f3b5-4fea-99bd-bed2dc85aeb2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:49.070705 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d6e9e12-f3b5-4fea-99bd-bed2dc85aeb2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:49.071453 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d6e9e12-f3b5-4fea-99bd-bed2dc85aeb2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:49.077954 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:49.302063 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8d6e9e12-f3b5-4fea-99bd-bed2dc85aeb2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:49.312025 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8d6e9e12-f3b5-4fea-99bd-bed2dc85aeb2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1273 microversion: 2.1 time: 0.274045 Aug 05 02:20:49.321688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 31/61] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:49 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1273 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:49.491522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4013250e-77e8-48c6-a31c-5f5642bdf1d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:49.492779 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4013250e-77e8-48c6-a31c-5f5642bdf1d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:49.507609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb8f0809-1a02-418d-b8fc-d8cee966da7c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:49.517344 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4013250e-77e8-48c6-a31c-5f5642bdf1d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:49.528191 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4013250e-77e8-48c6-a31c-5f5642bdf1d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:49.528939 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4013250e-77e8-48c6-a31c-5f5642bdf1d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:49.529812 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4013250e-77e8-48c6-a31c-5f5642bdf1d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:49.530278 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4013250e-77e8-48c6-a31c-5f5642bdf1d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:49.530709 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4013250e-77e8-48c6-a31c-5f5642bdf1d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:49.547165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb8f0809-1a02-418d-b8fc-d8cee966da7c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:49.558155 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb8f0809-1a02-418d-b8fc-d8cee966da7c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:49.565502 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb8f0809-1a02-418d-b8fc-d8cee966da7c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1341 microversion: 2.20 time: 0.590746 Aug 05 02:20:49.567394 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 31/62] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:20:48 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1341 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:20:49.594107 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4581e453-9640-4387-a141-49ee0838cd73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:49.599603 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4581e453-9640-4387-a141-49ee0838cd73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:49.625889 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4581e453-9640-4387-a141-49ee0838cd73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:49.627346 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4581e453-9640-4387-a141-49ee0838cd73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:49.629873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4581e453-9640-4387-a141-49ee0838cd73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:49.631953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4581e453-9640-4387-a141-49ee0838cd73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:49.633421 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4581e453-9640-4387-a141-49ee0838cd73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:49.635247 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4581e453-9640-4387-a141-49ee0838cd73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:49.920493 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4013250e-77e8-48c6-a31c-5f5642bdf1d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:49.934783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4013250e-77e8-48c6-a31c-5f5642bdf1d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1296 microversion: 2.1 time: 0.447425 Aug 05 02:20:49.950086 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 32/63] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:49 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1296 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:49.957777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4581e453-9640-4387-a141-49ee0838cd73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:49.971945 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4581e453-9640-4387-a141-49ee0838cd73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1290 microversion: 2.1 time: 0.399668 Aug 05 02:20:49.974151 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 32/64] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:49 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1290 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:49.995437 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2e8f2198-749e-4497-9ee7-e9fe0f5f40f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:49.996465 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2e8f2198-749e-4497-9ee7-e9fe0f5f40f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:50.003305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e8f2198-749e-4497-9ee7-e9fe0f5f40f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:50.004124 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e8f2198-749e-4497-9ee7-e9fe0f5f40f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:50.004822 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e8f2198-749e-4497-9ee7-e9fe0f5f40f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:50.005739 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e8f2198-749e-4497-9ee7-e9fe0f5f40f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:50.006485 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e8f2198-749e-4497-9ee7-e9fe0f5f40f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:50.007109 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e8f2198-749e-4497-9ee7-e9fe0f5f40f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:50.037680 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:50.244315 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2e8f2198-749e-4497-9ee7-e9fe0f5f40f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:50.254641 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2e8f2198-749e-4497-9ee7-e9fe0f5f40f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1300 microversion: 2.1 time: 0.264037 Aug 05 02:20:50.255664 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 33/65] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:49 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1300 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:50.347002 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7fa2853b-6f34-483a-ae22-677b87914e74 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:50.348847 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7fa2853b-6f34-483a-ae22-677b87914e74 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:50.362778 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fa2853b-6f34-483a-ae22-677b87914e74 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:50.364917 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fa2853b-6f34-483a-ae22-677b87914e74 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:50.365768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fa2853b-6f34-483a-ae22-677b87914e74 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:50.367102 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fa2853b-6f34-483a-ae22-677b87914e74 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:50.368826 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fa2853b-6f34-483a-ae22-677b87914e74 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:50.369264 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fa2853b-6f34-483a-ae22-677b87914e74 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:50.576268 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7fa2853b-6f34-483a-ae22-677b87914e74 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:50.595450 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5923d895-af8d-44f6-a3c6-40235bdc673d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:50.603925 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5923d895-af8d-44f6-a3c6-40235bdc673d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:50.609836 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7fa2853b-6f34-483a-ae22-677b87914e74 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1273 microversion: 2.1 time: 0.267857 Aug 05 02:20:50.612886 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 33/66] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:50 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:50.614410 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5923d895-af8d-44f6-a3c6-40235bdc673d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:50.617157 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5923d895-af8d-44f6-a3c6-40235bdc673d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:50.620713 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5923d895-af8d-44f6-a3c6-40235bdc673d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:50.622397 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5923d895-af8d-44f6-a3c6-40235bdc673d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:50.623038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5923d895-af8d-44f6-a3c6-40235bdc673d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:50.623615 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5923d895-af8d-44f6-a3c6-40235bdc673d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:50.957641 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5923d895-af8d-44f6-a3c6-40235bdc673d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:50.961706 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f9217d63-434f-4888-b908-c7a8fcbf6518 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:50.962769 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f9217d63-434f-4888-b908-c7a8fcbf6518 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:50.965335 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:50.983087 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9217d63-434f-4888-b908-c7a8fcbf6518 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:50.985155 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9217d63-434f-4888-b908-c7a8fcbf6518 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:50.986021 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9217d63-434f-4888-b908-c7a8fcbf6518 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:50.987119 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9217d63-434f-4888-b908-c7a8fcbf6518 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:50.993778 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9217d63-434f-4888-b908-c7a8fcbf6518 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:50.994442 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5923d895-af8d-44f6-a3c6-40235bdc673d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:50.995243 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9217d63-434f-4888-b908-c7a8fcbf6518 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:51.005922 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5923d895-af8d-44f6-a3c6-40235bdc673d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:51.007293 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5923d895-af8d-44f6-a3c6-40235bdc673d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1339 microversion: 2.20 time: 0.418002 Aug 05 02:20:51.008037 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 34/67] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:20:50 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1339 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:20:51.041106 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-25bd9e1d-1f85-4b0f-bbbb-0971790692a6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:51.042259 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-25bd9e1d-1f85-4b0f-bbbb-0971790692a6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:51.059853 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25bd9e1d-1f85-4b0f-bbbb-0971790692a6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:51.061007 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25bd9e1d-1f85-4b0f-bbbb-0971790692a6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:51.062325 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25bd9e1d-1f85-4b0f-bbbb-0971790692a6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:51.063325 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25bd9e1d-1f85-4b0f-bbbb-0971790692a6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:51.064060 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25bd9e1d-1f85-4b0f-bbbb-0971790692a6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:51.064973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25bd9e1d-1f85-4b0f-bbbb-0971790692a6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:51.750809 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-25bd9e1d-1f85-4b0f-bbbb-0971790692a6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:51.753613 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f9217d63-434f-4888-b908-c7a8fcbf6518 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:51.767307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-25bd9e1d-1f85-4b0f-bbbb-0971790692a6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1278 microversion: 2.1 time: 0.738509 Aug 05 02:20:51.767765 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f9217d63-434f-4888-b908-c7a8fcbf6518 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1294 microversion: 2.1 time: 0.811662 Aug 05 02:20:51.769546 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 34/68] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:50 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1294 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:51.778016 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 35/69] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:51 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1278 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:51.780593 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-08dba8d3-6cde-4e4b-aedd-414ff16562c8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:51.781409 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-08dba8d3-6cde-4e4b-aedd-414ff16562c8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:51.797864 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-52bc33bd-23dd-417f-b8ec-5f8189125e2e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:51.797864 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-52bc33bd-23dd-417f-b8ec-5f8189125e2e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:51.800386 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08dba8d3-6cde-4e4b-aedd-414ff16562c8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:51.801060 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08dba8d3-6cde-4e4b-aedd-414ff16562c8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:51.801650 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08dba8d3-6cde-4e4b-aedd-414ff16562c8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:51.804595 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08dba8d3-6cde-4e4b-aedd-414ff16562c8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:51.805213 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08dba8d3-6cde-4e4b-aedd-414ff16562c8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:51.807899 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52bc33bd-23dd-417f-b8ec-5f8189125e2e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:51.808539 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08dba8d3-6cde-4e4b-aedd-414ff16562c8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:51.808893 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52bc33bd-23dd-417f-b8ec-5f8189125e2e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:51.809385 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52bc33bd-23dd-417f-b8ec-5f8189125e2e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:51.811045 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52bc33bd-23dd-417f-b8ec-5f8189125e2e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:51.812179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52bc33bd-23dd-417f-b8ec-5f8189125e2e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:51.812774 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-52bc33bd-23dd-417f-b8ec-5f8189125e2e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:51.969483 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-08dba8d3-6cde-4e4b-aedd-414ff16562c8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:51.985128 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-08dba8d3-6cde-4e4b-aedd-414ff16562c8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1300 microversion: 2.1 time: 0.214094 Aug 05 02:20:52.001231 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 35/70] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:51 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1300 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:52.053663 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1981d1fe-fbdb-4195-bb81-3261c468c223 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:52.056922 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1981d1fe-fbdb-4195-bb81-3261c468c223 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:52.073412 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1981d1fe-fbdb-4195-bb81-3261c468c223 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:52.074217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1981d1fe-fbdb-4195-bb81-3261c468c223 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:52.074954 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1981d1fe-fbdb-4195-bb81-3261c468c223 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:52.076718 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1981d1fe-fbdb-4195-bb81-3261c468c223 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:52.082913 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1981d1fe-fbdb-4195-bb81-3261c468c223 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:52.083654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1981d1fe-fbdb-4195-bb81-3261c468c223 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:52.251173 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1981d1fe-fbdb-4195-bb81-3261c468c223 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:52.269081 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1981d1fe-fbdb-4195-bb81-3261c468c223 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:52.277483 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1981d1fe-fbdb-4195-bb81-3261c468c223 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:52.279081 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1981d1fe-fbdb-4195-bb81-3261c468c223 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1339 microversion: 2.20 time: 0.246062 Aug 05 02:20:52.280304 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 36/71] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:20:52 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1339 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:20:52.547566 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-52bc33bd-23dd-417f-b8ec-5f8189125e2e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:52.557686 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-52bc33bd-23dd-417f-b8ec-5f8189125e2e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.774871 Aug 05 02:20:52.560613 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 36/72] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:51 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:52.803105 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e7f7c869-23da-4c3a-aa01-3684af92c46b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:52.807003 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0c6679ca-256e-4bff-a76e-4864a25679db tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:52.807749 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0c6679ca-256e-4bff-a76e-4864a25679db tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:52.808731 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e7f7c869-23da-4c3a-aa01-3684af92c46b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:52.830051 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7f7c869-23da-4c3a-aa01-3684af92c46b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:52.837454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c6679ca-256e-4bff-a76e-4864a25679db tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:52.838046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7f7c869-23da-4c3a-aa01-3684af92c46b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:52.839671 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c6679ca-256e-4bff-a76e-4864a25679db tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:52.840408 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7f7c869-23da-4c3a-aa01-3684af92c46b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:52.842135 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c6679ca-256e-4bff-a76e-4864a25679db tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:52.843240 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c6679ca-256e-4bff-a76e-4864a25679db tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:52.843994 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7f7c869-23da-4c3a-aa01-3684af92c46b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:52.844870 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c6679ca-256e-4bff-a76e-4864a25679db tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:52.845663 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7f7c869-23da-4c3a-aa01-3684af92c46b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:52.846317 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c6679ca-256e-4bff-a76e-4864a25679db tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:52.847352 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e7f7c869-23da-4c3a-aa01-3684af92c46b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:53.107952 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e7f7c869-23da-4c3a-aa01-3684af92c46b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:53.124857 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e7f7c869-23da-4c3a-aa01-3684af92c46b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1294 microversion: 2.1 time: 0.337555 Aug 05 02:20:53.125452 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 37/73] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:52 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1294 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:53.144628 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0bbec487-bdda-4079-a713-239cb8f9bf5c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:53.154631 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0bbec487-bdda-4079-a713-239cb8f9bf5c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:53.174372 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0bbec487-bdda-4079-a713-239cb8f9bf5c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:53.182677 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0bbec487-bdda-4079-a713-239cb8f9bf5c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:53.183571 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0bbec487-bdda-4079-a713-239cb8f9bf5c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:53.188295 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0bbec487-bdda-4079-a713-239cb8f9bf5c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:53.190656 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0bbec487-bdda-4079-a713-239cb8f9bf5c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:53.191544 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0bbec487-bdda-4079-a713-239cb8f9bf5c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:53.193944 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:53.240625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=32 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:53.395469 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=28 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:54.062790 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c6679ca-256e-4bff-a76e-4864a25679db tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:54.080240 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0c6679ca-256e-4bff-a76e-4864a25679db tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 1.290646 Aug 05 02:20:54.082877 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 37/74] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:52 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:54.108863 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2a944736-9821-4f0e-aaf0-98982eb18d43 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:54.110248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2a944736-9821-4f0e-aaf0-98982eb18d43 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:54.134157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a944736-9821-4f0e-aaf0-98982eb18d43 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:54.137373 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a944736-9821-4f0e-aaf0-98982eb18d43 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:54.138624 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a944736-9821-4f0e-aaf0-98982eb18d43 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:54.141613 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a944736-9821-4f0e-aaf0-98982eb18d43 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:54.142255 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a944736-9821-4f0e-aaf0-98982eb18d43 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:54.142835 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a944736-9821-4f0e-aaf0-98982eb18d43 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:54.353501 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0bbec487-bdda-4079-a713-239cb8f9bf5c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:54.361628 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0bbec487-bdda-4079-a713-239cb8f9bf5c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 1.228691 Aug 05 02:20:54.370165 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 38/75] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:53 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:54.376143 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-00fa4dbb-9ddf-4a85-917c-52920f9eec02 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:54.378857 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-00fa4dbb-9ddf-4a85-917c-52920f9eec02 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:54.393946 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00fa4dbb-9ddf-4a85-917c-52920f9eec02 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:54.394814 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00fa4dbb-9ddf-4a85-917c-52920f9eec02 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:54.395836 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00fa4dbb-9ddf-4a85-917c-52920f9eec02 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:54.396834 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00fa4dbb-9ddf-4a85-917c-52920f9eec02 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:54.397489 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00fa4dbb-9ddf-4a85-917c-52920f9eec02 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:54.398161 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00fa4dbb-9ddf-4a85-917c-52920f9eec02 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:54.684001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2a944736-9821-4f0e-aaf0-98982eb18d43 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:54.702473 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2a944736-9821-4f0e-aaf0-98982eb18d43 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:54.704568 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2a944736-9821-4f0e-aaf0-98982eb18d43 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:54.710335 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2a944736-9821-4f0e-aaf0-98982eb18d43 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.625082 Aug 05 02:20:54.716917 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 38/76] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:20:54 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:20:54.722530 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1c104620-9fea-4191-a0e1-d7cce764f705 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:54.723138 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1c104620-9fea-4191-a0e1-d7cce764f705 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:54.744979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c104620-9fea-4191-a0e1-d7cce764f705 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:54.745474 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c104620-9fea-4191-a0e1-d7cce764f705 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:54.745924 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c104620-9fea-4191-a0e1-d7cce764f705 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:54.746610 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c104620-9fea-4191-a0e1-d7cce764f705 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:54.769662 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c104620-9fea-4191-a0e1-d7cce764f705 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:54.771153 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c104620-9fea-4191-a0e1-d7cce764f705 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:54.946204 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-00fa4dbb-9ddf-4a85-917c-52920f9eec02 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:54.964824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-00fa4dbb-9ddf-4a85-917c-52920f9eec02 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.591960 Aug 05 02:20:55.002174 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 39/77] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:54 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:55.106030 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-78669449-f74c-4f5f-8fa1-b438b632ccd0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:55.107444 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-78669449-f74c-4f5f-8fa1-b438b632ccd0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:55.127627 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78669449-f74c-4f5f-8fa1-b438b632ccd0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:55.128193 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78669449-f74c-4f5f-8fa1-b438b632ccd0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:55.128756 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78669449-f74c-4f5f-8fa1-b438b632ccd0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:55.129951 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78669449-f74c-4f5f-8fa1-b438b632ccd0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:55.129951 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78669449-f74c-4f5f-8fa1-b438b632ccd0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:55.130397 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78669449-f74c-4f5f-8fa1-b438b632ccd0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:55.197648 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1c104620-9fea-4191-a0e1-d7cce764f705 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:55.206160 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1c104620-9fea-4191-a0e1-d7cce764f705 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.487751 Aug 05 02:20:55.206835 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 39/78] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:54 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:55.385221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-30b14386-5cfb-4704-b223-51439b47cdd5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:55.386150 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-30b14386-5cfb-4704-b223-51439b47cdd5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:55.395907 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30b14386-5cfb-4704-b223-51439b47cdd5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:55.402846 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30b14386-5cfb-4704-b223-51439b47cdd5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:55.403968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30b14386-5cfb-4704-b223-51439b47cdd5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:55.404825 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30b14386-5cfb-4704-b223-51439b47cdd5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:55.405500 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30b14386-5cfb-4704-b223-51439b47cdd5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:55.406147 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30b14386-5cfb-4704-b223-51439b47cdd5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:56.046863 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-30b14386-5cfb-4704-b223-51439b47cdd5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:56.067947 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-30b14386-5cfb-4704-b223-51439b47cdd5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.686610 Aug 05 02:20:56.069108 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 40/79] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:55 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:56.076169 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8b06e323-a750-495e-9783-d5df3fc81a9b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:56.077042 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8b06e323-a750-495e-9783-d5df3fc81a9b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:56.089778 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b06e323-a750-495e-9783-d5df3fc81a9b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:56.091756 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b06e323-a750-495e-9783-d5df3fc81a9b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:56.094000 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b06e323-a750-495e-9783-d5df3fc81a9b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:56.096195 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b06e323-a750-495e-9783-d5df3fc81a9b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:56.097436 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b06e323-a750-495e-9783-d5df3fc81a9b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:56.098028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b06e323-a750-495e-9783-d5df3fc81a9b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:56.798244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8b06e323-a750-495e-9783-d5df3fc81a9b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:56.816663 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8b06e323-a750-495e-9783-d5df3fc81a9b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:56.816663 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8b06e323-a750-495e-9783-d5df3fc81a9b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:56.823213 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8b06e323-a750-495e-9783-d5df3fc81a9b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.749865 Aug 05 02:20:56.823213 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 41/80] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:20:56 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:20:56.827801 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8e4020a8-2bfe-43ff-a9a9-60d136c97d82 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:56.828702 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8e4020a8-2bfe-43ff-a9a9-60d136c97d82 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:56.835813 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e4020a8-2bfe-43ff-a9a9-60d136c97d82 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:56.836561 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e4020a8-2bfe-43ff-a9a9-60d136c97d82 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:56.837428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e4020a8-2bfe-43ff-a9a9-60d136c97d82 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:56.839228 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e4020a8-2bfe-43ff-a9a9-60d136c97d82 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:56.840078 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e4020a8-2bfe-43ff-a9a9-60d136c97d82 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:56.841644 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8e4020a8-2bfe-43ff-a9a9-60d136c97d82 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:57.000734 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-78669449-f74c-4f5f-8fa1-b438b632ccd0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:57.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-78669449-f74c-4f5f-8fa1-b438b632ccd0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 1.918624 Aug 05 02:20:57.021259 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 40/81] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:55 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:20:57.039449 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-05805c01-c474-4556-918d-0af60a83ae03 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:57.039987 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-05805c01-c474-4556-918d-0af60a83ae03 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:57.046771 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-05805c01-c474-4556-918d-0af60a83ae03 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:57.047309 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-05805c01-c474-4556-918d-0af60a83ae03 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:57.048016 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-05805c01-c474-4556-918d-0af60a83ae03 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:57.049151 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-05805c01-c474-4556-918d-0af60a83ae03 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:57.049271 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-05805c01-c474-4556-918d-0af60a83ae03 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:57.049615 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-05805c01-c474-4556-918d-0af60a83ae03 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:57.360452 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8e4020a8-2bfe-43ff-a9a9-60d136c97d82 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:57.383090 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8e4020a8-2bfe-43ff-a9a9-60d136c97d82 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.560988 Aug 05 02:20:57.400979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 42/82] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:56 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:57.572399 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-b8c8c94b-76c1-49cd-9051-0181607c93d4 req-1b98953d-4cf6-4d89-ab83-14ef3f9d99d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "786487b8-f24e-4034-82da-c95e8efbf4e4", "tag": "7f1f18fd-2855-4e72-99d7-6356085d6879"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:20:57.612367 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b8c8c94b-76c1-49cd-9051-0181607c93d4 req-1b98953d-4cf6-4d89-ab83-14ef3f9d99d9 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:57.613343 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b8c8c94b-76c1-49cd-9051-0181607c93d4 req-1b98953d-4cf6-4d89-ab83-14ef3f9d99d9 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:57.621355 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b8c8c94b-76c1-49cd-9051-0181607c93d4 req-1b98953d-4cf6-4d89-ab83-14ef3f9d99d9 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:57.683461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-b8c8c94b-76c1-49cd-9051-0181607c93d4 req-1b98953d-4cf6-4d89-ab83-14ef3f9d99d9 service nova] Creating event network-changed:7f1f18fd-2855-4e72-99d7-6356085d6879 for instance 786487b8-f24e-4034-82da-c95e8efbf4e4 on hv-cinder-81558 Aug 05 02:20:57.685825 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b8c8c94b-76c1-49cd-9051-0181607c93d4 req-1b98953d-4cf6-4d89-ab83-14ef3f9d99d9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 02:20:57.687740 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b8c8c94b-76c1-49cd-9051-0181607c93d4 req-1b98953d-4cf6-4d89-ab83-14ef3f9d99d9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 02:20:57.690547 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22159e35-c1be-4402-a276-44f14129d54e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:57.694118 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22159e35-c1be-4402-a276-44f14129d54e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:57.696145 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22159e35-c1be-4402-a276-44f14129d54e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:57.697239 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22159e35-c1be-4402-a276-44f14129d54e None None] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:57.700377 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22159e35-c1be-4402-a276-44f14129d54e None None] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:57.701319 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22159e35-c1be-4402-a276-44f14129d54e None None] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:57.725758 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.compute.rpcapi [None req-22159e35-c1be-4402-a276-44f14129d54e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 02:20:57.727910 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22159e35-c1be-4402-a276-44f14129d54e None None] Releasing lock "compute-rpcapi-router" {{(pid=117920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 02:20:57.771471 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-22159e35-c1be-4402-a276-44f14129d54e None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.368846 Aug 05 02:20:57.772843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 43/83] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:20:57.779274 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0a754578-e8be-44c9-aef8-f5128cb874ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:57.793465 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0a754578-e8be-44c9-aef8-f5128cb874ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:57.801460 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a754578-e8be-44c9-aef8-f5128cb874ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:57.802984 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a754578-e8be-44c9-aef8-f5128cb874ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:57.803747 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a754578-e8be-44c9-aef8-f5128cb874ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:57.804937 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a754578-e8be-44c9-aef8-f5128cb874ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:57.805822 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a754578-e8be-44c9-aef8-f5128cb874ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:57.806530 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a754578-e8be-44c9-aef8-f5128cb874ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:58.074109 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-05805c01-c474-4556-918d-0af60a83ae03 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:58.084750 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-05805c01-c474-4556-918d-0af60a83ae03 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 1.051158 Aug 05 02:20:58.085341 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 41/84] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:57 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:58.589667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0a754578-e8be-44c9-aef8-f5128cb874ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:58.603747 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0a754578-e8be-44c9-aef8-f5128cb874ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.828026 Aug 05 02:20:58.611538 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 44/85] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:57 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:58.616499 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d7b184eb-3301-4d84-9471-e4d8370efb8a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:58.616678 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-4587db17-ab94-49b0-ae48-c0c3ef3a2b3d req-a6c48a4a-dda6-44c2-b34d-9e16dfb3246d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3", "tag": "9d9c2151-858a-4f4b-ae99-508b1aadb74a"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:20:58.624269 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d7b184eb-3301-4d84-9471-e4d8370efb8a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:58.640120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7b184eb-3301-4d84-9471-e4d8370efb8a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:58.641006 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7b184eb-3301-4d84-9471-e4d8370efb8a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:58.641655 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7b184eb-3301-4d84-9471-e4d8370efb8a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:58.641761 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4587db17-ab94-49b0-ae48-c0c3ef3a2b3d req-a6c48a4a-dda6-44c2-b34d-9e16dfb3246d service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:58.642165 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4587db17-ab94-49b0-ae48-c0c3ef3a2b3d req-a6c48a4a-dda6-44c2-b34d-9e16dfb3246d service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:58.643058 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7b184eb-3301-4d84-9471-e4d8370efb8a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:58.643619 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7b184eb-3301-4d84-9471-e4d8370efb8a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:58.644219 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7b184eb-3301-4d84-9471-e4d8370efb8a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:58.645712 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4587db17-ab94-49b0-ae48-c0c3ef3a2b3d req-a6c48a4a-dda6-44c2-b34d-9e16dfb3246d service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:58.779284 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-4587db17-ab94-49b0-ae48-c0c3ef3a2b3d req-a6c48a4a-dda6-44c2-b34d-9e16dfb3246d service nova] Creating event network-changed:9d9c2151-858a-4f4b-ae99-508b1aadb74a for instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 on hv-cinder-81558 Aug 05 02:20:58.790902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4587db17-ab94-49b0-ae48-c0c3ef3a2b3d req-a6c48a4a-dda6-44c2-b34d-9e16dfb3246d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117921) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 05 02:20:58.793133 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4587db17-ab94-49b0-ae48-c0c3ef3a2b3d req-a6c48a4a-dda6-44c2-b34d-9e16dfb3246d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117921) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 05 02:20:58.796051 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fadcc86a-af5c-402b-ae9e-60b96595fce5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:58.802493 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fadcc86a-af5c-402b-ae9e-60b96595fce5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:58.809058 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fadcc86a-af5c-402b-ae9e-60b96595fce5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:58.810130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fadcc86a-af5c-402b-ae9e-60b96595fce5 None None] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:58.813697 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fadcc86a-af5c-402b-ae9e-60b96595fce5 None None] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:58.814290 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fadcc86a-af5c-402b-ae9e-60b96595fce5 None None] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:58.866094 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.compute.rpcapi [None req-fadcc86a-af5c-402b-ae9e-60b96595fce5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 05 02:20:58.867154 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fadcc86a-af5c-402b-ae9e-60b96595fce5 None None] Releasing lock "compute-rpcapi-router" {{(pid=117921) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 05 02:20:58.911413 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fadcc86a-af5c-402b-ae9e-60b96595fce5 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.823741 Aug 05 02:20:58.912248 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 42/86] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:20:58.917970 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ef4ed41c-0dc0-4356-b368-7975b82480a5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:58.919717 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ef4ed41c-0dc0-4356-b368-7975b82480a5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:58.937514 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef4ed41c-0dc0-4356-b368-7975b82480a5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:58.938509 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef4ed41c-0dc0-4356-b368-7975b82480a5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:58.939124 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef4ed41c-0dc0-4356-b368-7975b82480a5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:58.940023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef4ed41c-0dc0-4356-b368-7975b82480a5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:58.940700 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef4ed41c-0dc0-4356-b368-7975b82480a5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:58.941509 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef4ed41c-0dc0-4356-b368-7975b82480a5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:59.478519 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d7b184eb-3301-4d84-9471-e4d8370efb8a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:59.503641 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d7b184eb-3301-4d84-9471-e4d8370efb8a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:59.507024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d7b184eb-3301-4d84-9471-e4d8370efb8a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:59.508751 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d7b184eb-3301-4d84-9471-e4d8370efb8a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.895965 Aug 05 02:20:59.509704 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 45/87] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:20:58 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:20:59.529197 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bf65af78-be8a-4340-88b2-6f2520889b89 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:59.530316 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bf65af78-be8a-4340-88b2-6f2520889b89 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:59.543194 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ef4ed41c-0dc0-4356-b368-7975b82480a5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:20:59.574228 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ef4ed41c-0dc0-4356-b368-7975b82480a5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.660530 Aug 05 02:20:59.579152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf65af78-be8a-4340-88b2-6f2520889b89 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:59.580617 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 43/88] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:58 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:20:59.596821 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf65af78-be8a-4340-88b2-6f2520889b89 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:59.606794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf65af78-be8a-4340-88b2-6f2520889b89 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:59.608595 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf65af78-be8a-4340-88b2-6f2520889b89 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:59.609357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf65af78-be8a-4340-88b2-6f2520889b89 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:59.610037 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bf65af78-be8a-4340-88b2-6f2520889b89 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:59.649100 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6741e317-dd8c-411e-ae9e-61deeb288825 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:20:59.660580 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6741e317-dd8c-411e-ae9e-61deeb288825 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:20:59.675247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6741e317-dd8c-411e-ae9e-61deeb288825 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:59.676996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6741e317-dd8c-411e-ae9e-61deeb288825 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:59.678279 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6741e317-dd8c-411e-ae9e-61deeb288825 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:20:59.680654 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6741e317-dd8c-411e-ae9e-61deeb288825 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:20:59.681259 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6741e317-dd8c-411e-ae9e-61deeb288825 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:20:59.682236 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6741e317-dd8c-411e-ae9e-61deeb288825 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:00.032997 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bf65af78-be8a-4340-88b2-6f2520889b89 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:00.058363 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bf65af78-be8a-4340-88b2-6f2520889b89 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.547171 Aug 05 02:21:00.072699 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 46/89] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:59 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:00.094424 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4dca0ec5-6c2f-408e-8db4-6c51e3d763df tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:00.095290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4dca0ec5-6c2f-408e-8db4-6c51e3d763df tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:00.109147 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dca0ec5-6c2f-408e-8db4-6c51e3d763df tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:00.112282 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dca0ec5-6c2f-408e-8db4-6c51e3d763df tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:00.113596 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dca0ec5-6c2f-408e-8db4-6c51e3d763df tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:00.114845 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dca0ec5-6c2f-408e-8db4-6c51e3d763df tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:00.115537 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dca0ec5-6c2f-408e-8db4-6c51e3d763df tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:00.131907 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dca0ec5-6c2f-408e-8db4-6c51e3d763df tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:00.150246 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6741e317-dd8c-411e-ae9e-61deeb288825 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:00.176636 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6741e317-dd8c-411e-ae9e-61deeb288825 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.559146 Aug 05 02:21:00.179802 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 44/90] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:20:59 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:00.185971 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-b5d86d78-76a0-4eef-94ae-b3e9c36aaa41 req-e509ea04-f701-4187-b780-dbf289386d24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319a8a64-7b50-4fff-93b6-4498b53265ab", "tag": "661635b8-8836-4704-91ee-343c5d3a40eb"}, {"name": "network-changed", "server_uuid": "1a387642-9e46-4a64-8017-43786f426b70", "tag": "7885d180-df69-43cf-b111-f789955314dc"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:21:00.210281 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-b5d86d78-76a0-4eef-94ae-b3e9c36aaa41 req-e509ea04-f701-4187-b780-dbf289386d24 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:00.212046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-b5d86d78-76a0-4eef-94ae-b3e9c36aaa41 req-e509ea04-f701-4187-b780-dbf289386d24 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:00.213448 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-b5d86d78-76a0-4eef-94ae-b3e9c36aaa41 req-e509ea04-f701-4187-b780-dbf289386d24 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:00.235171 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-b5d86d78-76a0-4eef-94ae-b3e9c36aaa41 req-e509ea04-f701-4187-b780-dbf289386d24 service nova] Creating event network-changed:661635b8-8836-4704-91ee-343c5d3a40eb for instance 319a8a64-7b50-4fff-93b6-4498b53265ab on hv-cinder-81558 Aug 05 02:21:00.237335 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-b5d86d78-76a0-4eef-94ae-b3e9c36aaa41 req-e509ea04-f701-4187-b780-dbf289386d24 service nova] Creating event network-changed:7885d180-df69-43cf-b111-f789955314dc for instance 1a387642-9e46-4a64-8017-43786f426b70 on hv-cinder-81558 Aug 05 02:21:00.254408 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-b5d86d78-76a0-4eef-94ae-b3e9c36aaa41 req-e509ea04-f701-4187-b780-dbf289386d24 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.071463 Aug 05 02:21:00.258937 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 45/91] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:21:00.337041 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4dca0ec5-6c2f-408e-8db4-6c51e3d763df tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:00.349246 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4dca0ec5-6c2f-408e-8db4-6c51e3d763df tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.274462 Aug 05 02:21:00.359287 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 47/92] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:00 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:00.536832 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3126c33f-3c15-4bc6-baba-08341f7da18e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:00.538136 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3126c33f-3c15-4bc6-baba-08341f7da18e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:00.547502 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3126c33f-3c15-4bc6-baba-08341f7da18e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:00.548742 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3126c33f-3c15-4bc6-baba-08341f7da18e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:00.549364 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3126c33f-3c15-4bc6-baba-08341f7da18e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:00.550854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3126c33f-3c15-4bc6-baba-08341f7da18e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:00.551388 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3126c33f-3c15-4bc6-baba-08341f7da18e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:00.551928 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3126c33f-3c15-4bc6-baba-08341f7da18e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:00.604750 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b68730e9-0055-48f0-927a-5a1a0ae9fcfb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:00.605433 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b68730e9-0055-48f0-927a-5a1a0ae9fcfb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:00.611836 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b68730e9-0055-48f0-927a-5a1a0ae9fcfb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:00.612436 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b68730e9-0055-48f0-927a-5a1a0ae9fcfb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:00.612988 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b68730e9-0055-48f0-927a-5a1a0ae9fcfb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:00.613754 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b68730e9-0055-48f0-927a-5a1a0ae9fcfb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:00.614369 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b68730e9-0055-48f0-927a-5a1a0ae9fcfb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:00.614876 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b68730e9-0055-48f0-927a-5a1a0ae9fcfb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:00.633915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:00.713410 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3126c33f-3c15-4bc6-baba-08341f7da18e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:00.723635 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3126c33f-3c15-4bc6-baba-08341f7da18e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:00.725401 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3126c33f-3c15-4bc6-baba-08341f7da18e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:00.726828 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3126c33f-3c15-4bc6-baba-08341f7da18e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.194984 Aug 05 02:21:00.727532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 46/93] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:00 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:00.766171 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b68730e9-0055-48f0-927a-5a1a0ae9fcfb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:00.774224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b68730e9-0055-48f0-927a-5a1a0ae9fcfb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.173281 Aug 05 02:21:00.774792 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 48/94] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:00 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:00.948784 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-41c68f17-7d99-474b-8031-ead0beb18b15 req-8ebeffee-e12c-43bf-a119-ecc02e6ea84f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2", "tag": "b8c923b8-6769-42f5-972e-79420f4f0498"}, {"name": "network-changed", "server_uuid": "d325dc2e-780c-41fe-bdad-ac41805f3534", "tag": "c3c4ea12-20f0-402c-a002-d09aebd27024"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:21:00.959371 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-41c68f17-7d99-474b-8031-ead0beb18b15 req-8ebeffee-e12c-43bf-a119-ecc02e6ea84f service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:00.959837 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-41c68f17-7d99-474b-8031-ead0beb18b15 req-8ebeffee-e12c-43bf-a119-ecc02e6ea84f service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:00.960260 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-41c68f17-7d99-474b-8031-ead0beb18b15 req-8ebeffee-e12c-43bf-a119-ecc02e6ea84f service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:00.975856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-41c68f17-7d99-474b-8031-ead0beb18b15 req-8ebeffee-e12c-43bf-a119-ecc02e6ea84f service nova] Creating event network-changed:b8c923b8-6769-42f5-972e-79420f4f0498 for instance fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 on hv-cinder-81558 Aug 05 02:21:00.976397 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-41c68f17-7d99-474b-8031-ead0beb18b15 req-8ebeffee-e12c-43bf-a119-ecc02e6ea84f service nova] Creating event network-changed:c3c4ea12-20f0-402c-a002-d09aebd27024 for instance d325dc2e-780c-41fe-bdad-ac41805f3534 on hv-cinder-81558 Aug 05 02:21:00.983290 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-41c68f17-7d99-474b-8031-ead0beb18b15 req-8ebeffee-e12c-43bf-a119-ecc02e6ea84f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037961 Aug 05 02:21:00.983899 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 47/95] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:21:01.083014 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c1dc32b7-176b-4bad-bacc-59754e3154d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:01.083589 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c1dc32b7-176b-4bad-bacc-59754e3154d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:01.089533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1dc32b7-176b-4bad-bacc-59754e3154d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:01.090016 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1dc32b7-176b-4bad-bacc-59754e3154d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:01.090447 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1dc32b7-176b-4bad-bacc-59754e3154d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:01.091269 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1dc32b7-176b-4bad-bacc-59754e3154d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:01.091713 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1dc32b7-176b-4bad-bacc-59754e3154d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:01.092135 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1dc32b7-176b-4bad-bacc-59754e3154d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:01.199702 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-528f74cd-1dd3-46fa-9190-7f13a9c235ad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:01.202645 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-528f74cd-1dd3-46fa-9190-7f13a9c235ad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:01.210700 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-528f74cd-1dd3-46fa-9190-7f13a9c235ad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:01.211476 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-528f74cd-1dd3-46fa-9190-7f13a9c235ad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:01.212151 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-528f74cd-1dd3-46fa-9190-7f13a9c235ad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:01.213460 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-528f74cd-1dd3-46fa-9190-7f13a9c235ad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:01.214098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-528f74cd-1dd3-46fa-9190-7f13a9c235ad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:01.215262 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-528f74cd-1dd3-46fa-9190-7f13a9c235ad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:01.267151 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c1dc32b7-176b-4bad-bacc-59754e3154d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:01.289195 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c1dc32b7-176b-4bad-bacc-59754e3154d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.211411 Aug 05 02:21:01.292665 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 49/96] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:01 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:01.370043 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ee52a158-fe7f-4a2c-a507-fe35a2eca3f9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:01.370733 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ee52a158-fe7f-4a2c-a507-fe35a2eca3f9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:01.377913 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee52a158-fe7f-4a2c-a507-fe35a2eca3f9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:01.378690 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee52a158-fe7f-4a2c-a507-fe35a2eca3f9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:01.379188 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee52a158-fe7f-4a2c-a507-fe35a2eca3f9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:01.379946 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee52a158-fe7f-4a2c-a507-fe35a2eca3f9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:01.380515 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee52a158-fe7f-4a2c-a507-fe35a2eca3f9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:01.380999 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee52a158-fe7f-4a2c-a507-fe35a2eca3f9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:01.386083 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-528f74cd-1dd3-46fa-9190-7f13a9c235ad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:01.394565 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-528f74cd-1dd3-46fa-9190-7f13a9c235ad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.198898 Aug 05 02:21:01.395141 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 48/97] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:01 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:01.517720 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ee52a158-fe7f-4a2c-a507-fe35a2eca3f9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:01.525077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ee52a158-fe7f-4a2c-a507-fe35a2eca3f9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.158808 Aug 05 02:21:01.525644 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 50/98] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:01 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:01.753131 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d6ca0f46-ae3a-409f-9852-0317e7f9bf1a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:01.755141 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d6ca0f46-ae3a-409f-9852-0317e7f9bf1a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:01.766952 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d6ca0f46-ae3a-409f-9852-0317e7f9bf1a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:01.767923 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d6ca0f46-ae3a-409f-9852-0317e7f9bf1a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:01.768666 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d6ca0f46-ae3a-409f-9852-0317e7f9bf1a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:01.769815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d6ca0f46-ae3a-409f-9852-0317e7f9bf1a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:01.770553 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d6ca0f46-ae3a-409f-9852-0317e7f9bf1a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:01.771449 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d6ca0f46-ae3a-409f-9852-0317e7f9bf1a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:01.796386 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c3699542-9336-413c-b6db-2b3d35514763 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:01.797663 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c3699542-9336-413c-b6db-2b3d35514763 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:01.805523 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3699542-9336-413c-b6db-2b3d35514763 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:01.806233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3699542-9336-413c-b6db-2b3d35514763 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:01.806913 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3699542-9336-413c-b6db-2b3d35514763 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:01.807823 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3699542-9336-413c-b6db-2b3d35514763 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:01.808754 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3699542-9336-413c-b6db-2b3d35514763 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:01.810185 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3699542-9336-413c-b6db-2b3d35514763 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:01.939590 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d6ca0f46-ae3a-409f-9852-0317e7f9bf1a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:01.950323 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d6ca0f46-ae3a-409f-9852-0317e7f9bf1a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:01.951830 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d6ca0f46-ae3a-409f-9852-0317e7f9bf1a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:01.952970 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d6ca0f46-ae3a-409f-9852-0317e7f9bf1a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.207319 Aug 05 02:21:01.953528 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 49/99] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:01 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:01.964649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c3699542-9336-413c-b6db-2b3d35514763 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:01.973775 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c3699542-9336-413c-b6db-2b3d35514763 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.182539 Aug 05 02:21:01.974332 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 51/100] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:01 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:02.313434 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-dcc75b71-2c77-4429-a28b-a416172aab28 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:02.314035 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dcc75b71-2c77-4429-a28b-a416172aab28 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:02.321270 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dcc75b71-2c77-4429-a28b-a416172aab28 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:02.321877 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dcc75b71-2c77-4429-a28b-a416172aab28 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:02.322379 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dcc75b71-2c77-4429-a28b-a416172aab28 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:02.323071 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dcc75b71-2c77-4429-a28b-a416172aab28 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:02.323521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dcc75b71-2c77-4429-a28b-a416172aab28 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:02.324361 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dcc75b71-2c77-4429-a28b-a416172aab28 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:02.414822 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5c9b4176-d761-4571-80ed-8f559efb4991 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:02.415561 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5c9b4176-d761-4571-80ed-8f559efb4991 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:02.423218 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c9b4176-d761-4571-80ed-8f559efb4991 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:02.423714 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c9b4176-d761-4571-80ed-8f559efb4991 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:02.424156 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c9b4176-d761-4571-80ed-8f559efb4991 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:02.424929 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c9b4176-d761-4571-80ed-8f559efb4991 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:02.425590 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c9b4176-d761-4571-80ed-8f559efb4991 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:02.426194 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5c9b4176-d761-4571-80ed-8f559efb4991 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:02.470313 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-dcc75b71-2c77-4429-a28b-a416172aab28 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:02.478679 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-dcc75b71-2c77-4429-a28b-a416172aab28 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.168922 Aug 05 02:21:02.480811 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 50/101] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:02 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:02.547995 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d683452c-4cd4-49f0-8475-4d6deb3b842c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:02.549309 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d683452c-4cd4-49f0-8475-4d6deb3b842c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:02.556523 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d683452c-4cd4-49f0-8475-4d6deb3b842c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:02.557433 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d683452c-4cd4-49f0-8475-4d6deb3b842c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:02.558187 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d683452c-4cd4-49f0-8475-4d6deb3b842c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:02.559110 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d683452c-4cd4-49f0-8475-4d6deb3b842c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:02.561373 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d683452c-4cd4-49f0-8475-4d6deb3b842c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:02.562010 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d683452c-4cd4-49f0-8475-4d6deb3b842c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:02.594990 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5c9b4176-d761-4571-80ed-8f559efb4991 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:02.605319 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5c9b4176-d761-4571-80ed-8f559efb4991 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.193949 Aug 05 02:21:02.606733 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 52/102] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:02 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:02.767763 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d683452c-4cd4-49f0-8475-4d6deb3b842c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:02.772251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:02.779793 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d683452c-4cd4-49f0-8475-4d6deb3b842c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.236531 Aug 05 02:21:02.780481 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 51/103] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:02 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:02.976752 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ffec5c0e-2cbe-4777-81a9-c5166e323387 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:02.977533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ffec5c0e-2cbe-4777-81a9-c5166e323387 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:02.984478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffec5c0e-2cbe-4777-81a9-c5166e323387 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:02.985068 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffec5c0e-2cbe-4777-81a9-c5166e323387 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:02.985562 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffec5c0e-2cbe-4777-81a9-c5166e323387 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:02.986726 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffec5c0e-2cbe-4777-81a9-c5166e323387 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:02.988670 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffec5c0e-2cbe-4777-81a9-c5166e323387 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:02.988670 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffec5c0e-2cbe-4777-81a9-c5166e323387 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:02.998587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fee5f47c-65c6-4902-a803-36178c700c8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:02.999244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fee5f47c-65c6-4902-a803-36178c700c8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:03.006250 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fee5f47c-65c6-4902-a803-36178c700c8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:03.006734 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fee5f47c-65c6-4902-a803-36178c700c8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:03.007192 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fee5f47c-65c6-4902-a803-36178c700c8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:03.008361 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fee5f47c-65c6-4902-a803-36178c700c8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:03.008969 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fee5f47c-65c6-4902-a803-36178c700c8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:03.009542 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fee5f47c-65c6-4902-a803-36178c700c8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:03.146072 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ffec5c0e-2cbe-4777-81a9-c5166e323387 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:03.155223 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ffec5c0e-2cbe-4777-81a9-c5166e323387 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:03.157155 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ffec5c0e-2cbe-4777-81a9-c5166e323387 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:03.158348 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ffec5c0e-2cbe-4777-81a9-c5166e323387 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.185658 Aug 05 02:21:03.158899 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 53/104] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:02 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:03.207705 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fee5f47c-65c6-4902-a803-36178c700c8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:03.215556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fee5f47c-65c6-4902-a803-36178c700c8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.225085 Aug 05 02:21:03.228157 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 52/105] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:02 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:03.502637 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7fac91f6-4d93-48f2-82ee-cb8c97e98f24 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:03.503282 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7fac91f6-4d93-48f2-82ee-cb8c97e98f24 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:03.509942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fac91f6-4d93-48f2-82ee-cb8c97e98f24 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:03.510507 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fac91f6-4d93-48f2-82ee-cb8c97e98f24 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:03.511011 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fac91f6-4d93-48f2-82ee-cb8c97e98f24 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:03.513096 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fac91f6-4d93-48f2-82ee-cb8c97e98f24 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:03.514282 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fac91f6-4d93-48f2-82ee-cb8c97e98f24 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:03.514806 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fac91f6-4d93-48f2-82ee-cb8c97e98f24 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:03.626791 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4b93b576-1f84-47da-99e6-8fbf97534849 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:03.627403 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4b93b576-1f84-47da-99e6-8fbf97534849 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:03.634076 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b93b576-1f84-47da-99e6-8fbf97534849 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:03.634812 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b93b576-1f84-47da-99e6-8fbf97534849 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:03.635405 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b93b576-1f84-47da-99e6-8fbf97534849 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:03.636290 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b93b576-1f84-47da-99e6-8fbf97534849 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:03.636866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b93b576-1f84-47da-99e6-8fbf97534849 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:03.637183 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b93b576-1f84-47da-99e6-8fbf97534849 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:03.876214 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7fac91f6-4d93-48f2-82ee-cb8c97e98f24 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:03.884559 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7fac91f6-4d93-48f2-82ee-cb8c97e98f24 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.386444 Aug 05 02:21:03.885136 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 54/106] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:03 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:03.891448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e83ce2f4-5e57-4e9a-9951-582894a68b09 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:03.892145 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e83ce2f4-5e57-4e9a-9951-582894a68b09 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:03.898496 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e83ce2f4-5e57-4e9a-9951-582894a68b09 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:03.899164 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e83ce2f4-5e57-4e9a-9951-582894a68b09 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:03.899901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e83ce2f4-5e57-4e9a-9951-582894a68b09 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:03.900779 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e83ce2f4-5e57-4e9a-9951-582894a68b09 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:03.901380 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e83ce2f4-5e57-4e9a-9951-582894a68b09 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:03.901809 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e83ce2f4-5e57-4e9a-9951-582894a68b09 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:03.916503 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4b93b576-1f84-47da-99e6-8fbf97534849 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:03.929722 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4b93b576-1f84-47da-99e6-8fbf97534849 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.306623 Aug 05 02:21:03.933187 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 53/107] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:03 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:04.065497 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e83ce2f4-5e57-4e9a-9951-582894a68b09 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:04.075863 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e83ce2f4-5e57-4e9a-9951-582894a68b09 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.188512 Aug 05 02:21:04.076511 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 55/108] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:03 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:04.179236 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ee7cdc64-9ab4-4955-b798-726cb935ef34 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:04.179924 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ee7cdc64-9ab4-4955-b798-726cb935ef34 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:04.186829 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee7cdc64-9ab4-4955-b798-726cb935ef34 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:04.187245 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee7cdc64-9ab4-4955-b798-726cb935ef34 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:04.187622 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee7cdc64-9ab4-4955-b798-726cb935ef34 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:04.188300 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee7cdc64-9ab4-4955-b798-726cb935ef34 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:04.188783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee7cdc64-9ab4-4955-b798-726cb935ef34 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:04.189208 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee7cdc64-9ab4-4955-b798-726cb935ef34 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:04.241009 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0ef4e2ff-0091-4b63-8345-893484341fbb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:04.241852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0ef4e2ff-0091-4b63-8345-893484341fbb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:04.250072 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ef4e2ff-0091-4b63-8345-893484341fbb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:04.250734 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ef4e2ff-0091-4b63-8345-893484341fbb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:04.251386 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ef4e2ff-0091-4b63-8345-893484341fbb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:04.253250 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ef4e2ff-0091-4b63-8345-893484341fbb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:04.253871 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ef4e2ff-0091-4b63-8345-893484341fbb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:04.254468 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ef4e2ff-0091-4b63-8345-893484341fbb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:04.354188 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ee7cdc64-9ab4-4955-b798-726cb935ef34 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:04.363960 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ee7cdc64-9ab4-4955-b798-726cb935ef34 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:04.365858 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ee7cdc64-9ab4-4955-b798-726cb935ef34 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:04.367139 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ee7cdc64-9ab4-4955-b798-726cb935ef34 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.191602 Aug 05 02:21:04.375606 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 54/109] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:04 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:04.439650 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0ef4e2ff-0091-4b63-8345-893484341fbb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:04.455951 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0ef4e2ff-0091-4b63-8345-893484341fbb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.219522 Aug 05 02:21:04.456555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 56/110] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:04 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:04.905660 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9f242803-37d8-440f-8f68-98ecbc721c09 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:04.906262 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9f242803-37d8-440f-8f68-98ecbc721c09 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:04.911940 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f242803-37d8-440f-8f68-98ecbc721c09 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:04.912445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f242803-37d8-440f-8f68-98ecbc721c09 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:04.912872 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f242803-37d8-440f-8f68-98ecbc721c09 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:04.913545 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f242803-37d8-440f-8f68-98ecbc721c09 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:04.913986 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f242803-37d8-440f-8f68-98ecbc721c09 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:04.914403 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f242803-37d8-440f-8f68-98ecbc721c09 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:04.953013 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fc12b1e0-7a87-4985-bc8d-452aac5abb60 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:04.953623 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fc12b1e0-7a87-4985-bc8d-452aac5abb60 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:04.960762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc12b1e0-7a87-4985-bc8d-452aac5abb60 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:04.961291 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc12b1e0-7a87-4985-bc8d-452aac5abb60 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:04.961731 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc12b1e0-7a87-4985-bc8d-452aac5abb60 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:04.962431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc12b1e0-7a87-4985-bc8d-452aac5abb60 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:04.962884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc12b1e0-7a87-4985-bc8d-452aac5abb60 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:04.963309 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc12b1e0-7a87-4985-bc8d-452aac5abb60 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:05.055413 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9f242803-37d8-440f-8f68-98ecbc721c09 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:05.064171 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9f242803-37d8-440f-8f68-98ecbc721c09 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.162473 Aug 05 02:21:05.064776 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 55/111] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:04 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:05.099226 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-58e38d51-80bf-41fd-8d88-5319e04f8b9a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:05.099846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-58e38d51-80bf-41fd-8d88-5319e04f8b9a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:05.105725 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58e38d51-80bf-41fd-8d88-5319e04f8b9a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:05.106203 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58e38d51-80bf-41fd-8d88-5319e04f8b9a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:05.106528 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fc12b1e0-7a87-4985-bc8d-452aac5abb60 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:05.107038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58e38d51-80bf-41fd-8d88-5319e04f8b9a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:05.107572 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58e38d51-80bf-41fd-8d88-5319e04f8b9a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:05.108850 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58e38d51-80bf-41fd-8d88-5319e04f8b9a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:05.109501 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58e38d51-80bf-41fd-8d88-5319e04f8b9a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:05.116054 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fc12b1e0-7a87-4985-bc8d-452aac5abb60 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.167946 Aug 05 02:21:05.116667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 57/112] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:04 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:05.267467 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-58e38d51-80bf-41fd-8d88-5319e04f8b9a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:05.278930 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-58e38d51-80bf-41fd-8d88-5319e04f8b9a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.183457 Aug 05 02:21:05.282598 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 56/113] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:05 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:05.397700 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b5b11b84-76cd-4132-be46-ef3d661fe342 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:05.398295 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b5b11b84-76cd-4132-be46-ef3d661fe342 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:05.405424 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5b11b84-76cd-4132-be46-ef3d661fe342 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:05.405424 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5b11b84-76cd-4132-be46-ef3d661fe342 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:05.405424 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5b11b84-76cd-4132-be46-ef3d661fe342 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:05.406018 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5b11b84-76cd-4132-be46-ef3d661fe342 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:05.406461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5b11b84-76cd-4132-be46-ef3d661fe342 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:05.407016 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5b11b84-76cd-4132-be46-ef3d661fe342 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:05.477433 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-99a001d1-cd4a-40c1-ba6d-a6ff73817df3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:05.478118 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-99a001d1-cd4a-40c1-ba6d-a6ff73817df3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:05.485225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99a001d1-cd4a-40c1-ba6d-a6ff73817df3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:05.485710 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99a001d1-cd4a-40c1-ba6d-a6ff73817df3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:05.486160 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99a001d1-cd4a-40c1-ba6d-a6ff73817df3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:05.486840 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99a001d1-cd4a-40c1-ba6d-a6ff73817df3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:05.487302 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99a001d1-cd4a-40c1-ba6d-a6ff73817df3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:05.487722 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99a001d1-cd4a-40c1-ba6d-a6ff73817df3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:05.550599 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b5b11b84-76cd-4132-be46-ef3d661fe342 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:05.559113 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b5b11b84-76cd-4132-be46-ef3d661fe342 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:05.560905 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b5b11b84-76cd-4132-be46-ef3d661fe342 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:05.562414 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b5b11b84-76cd-4132-be46-ef3d661fe342 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.168503 Aug 05 02:21:05.562963 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 58/114] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:05 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:05.644810 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-99a001d1-cd4a-40c1-ba6d-a6ff73817df3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:05.652171 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-99a001d1-cd4a-40c1-ba6d-a6ff73817df3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.178553 Aug 05 02:21:05.652759 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 57/115] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:05 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:06.088123 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-162e6e7b-bac6-49b7-922b-c778c00c01c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:06.089126 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-162e6e7b-bac6-49b7-922b-c778c00c01c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:06.095992 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-162e6e7b-bac6-49b7-922b-c778c00c01c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:06.096978 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-162e6e7b-bac6-49b7-922b-c778c00c01c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:06.097587 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-162e6e7b-bac6-49b7-922b-c778c00c01c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:06.098623 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-162e6e7b-bac6-49b7-922b-c778c00c01c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:06.099403 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-162e6e7b-bac6-49b7-922b-c778c00c01c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:06.100231 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-162e6e7b-bac6-49b7-922b-c778c00c01c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:06.139724 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b12ce4f7-ab12-442b-b09e-354ba04e7159 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:06.140724 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b12ce4f7-ab12-442b-b09e-354ba04e7159 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:06.147904 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b12ce4f7-ab12-442b-b09e-354ba04e7159 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:06.148827 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b12ce4f7-ab12-442b-b09e-354ba04e7159 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:06.149256 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b12ce4f7-ab12-442b-b09e-354ba04e7159 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:06.150047 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b12ce4f7-ab12-442b-b09e-354ba04e7159 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:06.150520 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b12ce4f7-ab12-442b-b09e-354ba04e7159 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:06.150909 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b12ce4f7-ab12-442b-b09e-354ba04e7159 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:06.283897 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b12ce4f7-ab12-442b-b09e-354ba04e7159 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:06.292465 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b12ce4f7-ab12-442b-b09e-354ba04e7159 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.157270 Aug 05 02:21:06.293064 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 58/116] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:06 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:06.321400 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9115b4ea-418d-4444-9f83-7d9971c3eb24 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:06.321989 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9115b4ea-418d-4444-9f83-7d9971c3eb24 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:06.328693 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9115b4ea-418d-4444-9f83-7d9971c3eb24 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:06.329190 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9115b4ea-418d-4444-9f83-7d9971c3eb24 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:06.329623 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9115b4ea-418d-4444-9f83-7d9971c3eb24 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:06.330538 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9115b4ea-418d-4444-9f83-7d9971c3eb24 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:06.330995 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9115b4ea-418d-4444-9f83-7d9971c3eb24 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:06.331421 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9115b4ea-418d-4444-9f83-7d9971c3eb24 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:06.482476 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9115b4ea-418d-4444-9f83-7d9971c3eb24 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:06.491077 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9115b4ea-418d-4444-9f83-7d9971c3eb24 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.173535 Aug 05 02:21:06.491759 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 59/117] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:06 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:06.592178 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b4b37ab2-8657-447b-b825-cd702fb61f2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:06.594120 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b4b37ab2-8657-447b-b825-cd702fb61f2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:06.605176 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4b37ab2-8657-447b-b825-cd702fb61f2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:06.605926 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4b37ab2-8657-447b-b825-cd702fb61f2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:06.607212 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4b37ab2-8657-447b-b825-cd702fb61f2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:06.609582 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4b37ab2-8657-447b-b825-cd702fb61f2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:06.610616 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4b37ab2-8657-447b-b825-cd702fb61f2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:06.611239 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4b37ab2-8657-447b-b825-cd702fb61f2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:06.616305 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-162e6e7b-bac6-49b7-922b-c778c00c01c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:06.637778 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-162e6e7b-bac6-49b7-922b-c778c00c01c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.548770 Aug 05 02:21:06.640099 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 59/118] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:06 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:06.675820 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-283a72cf-0145-470f-89bd-9d839fc7df51 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:06.676708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-283a72cf-0145-470f-89bd-9d839fc7df51 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:06.690651 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-283a72cf-0145-470f-89bd-9d839fc7df51 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:06.693631 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-283a72cf-0145-470f-89bd-9d839fc7df51 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:06.694236 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-283a72cf-0145-470f-89bd-9d839fc7df51 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:06.695889 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-283a72cf-0145-470f-89bd-9d839fc7df51 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:06.697001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-283a72cf-0145-470f-89bd-9d839fc7df51 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:06.698768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-283a72cf-0145-470f-89bd-9d839fc7df51 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:06.793237 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b4b37ab2-8657-447b-b825-cd702fb61f2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:06.802890 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b4b37ab2-8657-447b-b825-cd702fb61f2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:06.804886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b4b37ab2-8657-447b-b825-cd702fb61f2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:06.806469 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b4b37ab2-8657-447b-b825-cd702fb61f2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.222918 Aug 05 02:21:06.807028 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 60/119] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:06 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:21:06.983681 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-283a72cf-0145-470f-89bd-9d839fc7df51 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:06.992289 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-283a72cf-0145-470f-89bd-9d839fc7df51 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.322594 Aug 05 02:21:06.993061 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 60/120] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:06 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:07.316444 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-551fe595-b760-499b-8a34-3d869feb6a0f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:07.317754 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-551fe595-b760-499b-8a34-3d869feb6a0f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:07.323759 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-551fe595-b760-499b-8a34-3d869feb6a0f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:07.324443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-551fe595-b760-499b-8a34-3d869feb6a0f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:07.324924 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-551fe595-b760-499b-8a34-3d869feb6a0f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:07.325625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-551fe595-b760-499b-8a34-3d869feb6a0f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:07.326070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-551fe595-b760-499b-8a34-3d869feb6a0f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:07.327786 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-551fe595-b760-499b-8a34-3d869feb6a0f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:07.481131 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-551fe595-b760-499b-8a34-3d869feb6a0f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:07.489380 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-551fe595-b760-499b-8a34-3d869feb6a0f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.179164 Aug 05 02:21:07.489951 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 61/121] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:07 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:07.512618 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3acea686-5335-437a-ab3c-80eba492c313 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:07.513507 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3acea686-5335-437a-ab3c-80eba492c313 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:07.524182 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3acea686-5335-437a-ab3c-80eba492c313 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:07.528807 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3acea686-5335-437a-ab3c-80eba492c313 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:07.529266 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3acea686-5335-437a-ab3c-80eba492c313 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:07.530209 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3acea686-5335-437a-ab3c-80eba492c313 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:07.530799 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3acea686-5335-437a-ab3c-80eba492c313 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:07.531453 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3acea686-5335-437a-ab3c-80eba492c313 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:07.660124 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-57e8f782-ebb3-42a5-b3f6-0f8abedc1556 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:07.660672 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-57e8f782-ebb3-42a5-b3f6-0f8abedc1556 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:07.666446 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57e8f782-ebb3-42a5-b3f6-0f8abedc1556 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:07.667117 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57e8f782-ebb3-42a5-b3f6-0f8abedc1556 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:07.667551 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57e8f782-ebb3-42a5-b3f6-0f8abedc1556 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:07.668232 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57e8f782-ebb3-42a5-b3f6-0f8abedc1556 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:07.668706 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57e8f782-ebb3-42a5-b3f6-0f8abedc1556 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:07.669367 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57e8f782-ebb3-42a5-b3f6-0f8abedc1556 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:07.682501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3acea686-5335-437a-ab3c-80eba492c313 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:07.690712 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3acea686-5335-437a-ab3c-80eba492c313 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.182095 Aug 05 02:21:07.691290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 61/122] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:07 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:07.853425 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-57e8f782-ebb3-42a5-b3f6-0f8abedc1556 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:07.855419 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c3e1382d-ba9b-4c01-a2d5-46680d636eaa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:07.856562 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c3e1382d-ba9b-4c01-a2d5-46680d636eaa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:07.861070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-57e8f782-ebb3-42a5-b3f6-0f8abedc1556 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.205301 Aug 05 02:21:07.861822 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 62/123] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:07 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:07.867306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:07.876667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3e1382d-ba9b-4c01-a2d5-46680d636eaa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:07.876667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3e1382d-ba9b-4c01-a2d5-46680d636eaa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:07.876667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3e1382d-ba9b-4c01-a2d5-46680d636eaa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:07.876667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3e1382d-ba9b-4c01-a2d5-46680d636eaa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:07.876996 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3e1382d-ba9b-4c01-a2d5-46680d636eaa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:07.876996 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c3e1382d-ba9b-4c01-a2d5-46680d636eaa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:08.012170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c3e1382d-ba9b-4c01-a2d5-46680d636eaa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:08.013475 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c82e5d9f-8e5c-4429-aa60-1ade9d6b5adf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:08.014234 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c82e5d9f-8e5c-4429-aa60-1ade9d6b5adf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:08.021156 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c82e5d9f-8e5c-4429-aa60-1ade9d6b5adf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:08.021430 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c3e1382d-ba9b-4c01-a2d5-46680d636eaa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:08.021750 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c82e5d9f-8e5c-4429-aa60-1ade9d6b5adf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:08.022191 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c82e5d9f-8e5c-4429-aa60-1ade9d6b5adf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:08.022960 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c3e1382d-ba9b-4c01-a2d5-46680d636eaa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:08.023094 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c82e5d9f-8e5c-4429-aa60-1ade9d6b5adf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:08.023409 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c82e5d9f-8e5c-4429-aa60-1ade9d6b5adf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:08.023886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c82e5d9f-8e5c-4429-aa60-1ade9d6b5adf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:08.024053 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c3e1382d-ba9b-4c01-a2d5-46680d636eaa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.191906 Aug 05 02:21:08.024628 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 62/124] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:07 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:08.164669 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c82e5d9f-8e5c-4429-aa60-1ade9d6b5adf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:08.173211 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c82e5d9f-8e5c-4429-aa60-1ade9d6b5adf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.163581 Aug 05 02:21:08.173775 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 63/125] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:08 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:08.514854 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9b8bcac3-e739-4d09-9cf9-b11f3d747b10 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:08.515472 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9b8bcac3-e739-4d09-9cf9-b11f3d747b10 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:08.521414 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b8bcac3-e739-4d09-9cf9-b11f3d747b10 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:08.521897 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b8bcac3-e739-4d09-9cf9-b11f3d747b10 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:08.522331 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b8bcac3-e739-4d09-9cf9-b11f3d747b10 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:08.523020 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b8bcac3-e739-4d09-9cf9-b11f3d747b10 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:08.523469 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b8bcac3-e739-4d09-9cf9-b11f3d747b10 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:08.523888 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b8bcac3-e739-4d09-9cf9-b11f3d747b10 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:08.662939 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9b8bcac3-e739-4d09-9cf9-b11f3d747b10 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:08.671206 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9b8bcac3-e739-4d09-9cf9-b11f3d747b10 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.160556 Aug 05 02:21:08.671772 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 63/126] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:08 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:08.711118 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c28361a4-2199-49ef-a7dd-1e7f8fee20db tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:08.711718 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c28361a4-2199-49ef-a7dd-1e7f8fee20db tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:08.718887 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c28361a4-2199-49ef-a7dd-1e7f8fee20db tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:08.719450 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c28361a4-2199-49ef-a7dd-1e7f8fee20db tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:08.719989 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c28361a4-2199-49ef-a7dd-1e7f8fee20db tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:08.720815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c28361a4-2199-49ef-a7dd-1e7f8fee20db tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:08.721485 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c28361a4-2199-49ef-a7dd-1e7f8fee20db tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:08.721944 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c28361a4-2199-49ef-a7dd-1e7f8fee20db tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:08.843919 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:08.862117 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c28361a4-2199-49ef-a7dd-1e7f8fee20db tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:08.869532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c28361a4-2199-49ef-a7dd-1e7f8fee20db tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.162111 Aug 05 02:21:08.870092 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 64/127] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:08 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:08.885403 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-46540cd4-114e-4fcb-ab46-a8ad7b542c26 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:08.888224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-46540cd4-114e-4fcb-ab46-a8ad7b542c26 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:08.906247 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46540cd4-114e-4fcb-ab46-a8ad7b542c26 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:08.906881 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46540cd4-114e-4fcb-ab46-a8ad7b542c26 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:08.907474 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46540cd4-114e-4fcb-ab46-a8ad7b542c26 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:08.908262 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46540cd4-114e-4fcb-ab46-a8ad7b542c26 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:08.908813 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46540cd4-114e-4fcb-ab46-a8ad7b542c26 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:08.909246 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46540cd4-114e-4fcb-ab46-a8ad7b542c26 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:09.047074 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8254d821-4e8f-49c6-855a-07ec54fe4fe4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:09.047711 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8254d821-4e8f-49c6-855a-07ec54fe4fe4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:09.051127 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-46540cd4-114e-4fcb-ab46-a8ad7b542c26 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:09.053968 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8254d821-4e8f-49c6-855a-07ec54fe4fe4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:09.054635 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8254d821-4e8f-49c6-855a-07ec54fe4fe4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:09.055209 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8254d821-4e8f-49c6-855a-07ec54fe4fe4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:09.056038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8254d821-4e8f-49c6-855a-07ec54fe4fe4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:09.056656 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8254d821-4e8f-49c6-855a-07ec54fe4fe4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:09.057211 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8254d821-4e8f-49c6-855a-07ec54fe4fe4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:09.059134 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-46540cd4-114e-4fcb-ab46-a8ad7b542c26 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.178754 Aug 05 02:21:09.059972 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 64/128] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:08 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:09.191512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8254d821-4e8f-49c6-855a-07ec54fe4fe4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:09.194359 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8fbb0cbf-341e-4f5c-b3be-7871531aa99d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:09.194968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8fbb0cbf-341e-4f5c-b3be-7871531aa99d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:09.199909 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8254d821-4e8f-49c6-855a-07ec54fe4fe4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:09.201428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8fbb0cbf-341e-4f5c-b3be-7871531aa99d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:09.202046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8254d821-4e8f-49c6-855a-07ec54fe4fe4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:09.202221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8fbb0cbf-341e-4f5c-b3be-7871531aa99d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:09.202655 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8fbb0cbf-341e-4f5c-b3be-7871531aa99d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:09.203227 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8254d821-4e8f-49c6-855a-07ec54fe4fe4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.160871 Aug 05 02:21:09.203447 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8fbb0cbf-341e-4f5c-b3be-7871531aa99d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:09.203765 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 65/129] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:09 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:09.204043 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8fbb0cbf-341e-4f5c-b3be-7871531aa99d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:09.204542 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8fbb0cbf-341e-4f5c-b3be-7871531aa99d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:09.210508 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:09.335862 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8fbb0cbf-341e-4f5c-b3be-7871531aa99d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:09.344039 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8fbb0cbf-341e-4f5c-b3be-7871531aa99d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.153860 Aug 05 02:21:09.344633 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 65/130] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:09 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:09.691725 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7862f114-5d8f-4c0c-ac96-e2e90647afb2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:09.692349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7862f114-5d8f-4c0c-ac96-e2e90647afb2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:09.698134 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7862f114-5d8f-4c0c-ac96-e2e90647afb2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:09.698621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7862f114-5d8f-4c0c-ac96-e2e90647afb2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:09.699056 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7862f114-5d8f-4c0c-ac96-e2e90647afb2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:09.699742 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7862f114-5d8f-4c0c-ac96-e2e90647afb2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:09.700195 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7862f114-5d8f-4c0c-ac96-e2e90647afb2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:09.700650 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7862f114-5d8f-4c0c-ac96-e2e90647afb2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:09.833111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7862f114-5d8f-4c0c-ac96-e2e90647afb2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:09.840534 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7862f114-5d8f-4c0c-ac96-e2e90647afb2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.152534 Aug 05 02:21:09.841120 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 66/131] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:09 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:09.891074 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-32982346-c9eb-4682-8da3-156816589988 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:09.891677 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-32982346-c9eb-4682-8da3-156816589988 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:09.897894 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32982346-c9eb-4682-8da3-156816589988 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:09.898361 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32982346-c9eb-4682-8da3-156816589988 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:09.898786 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32982346-c9eb-4682-8da3-156816589988 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:09.899458 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32982346-c9eb-4682-8da3-156816589988 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:09.899899 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32982346-c9eb-4682-8da3-156816589988 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:09.900312 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32982346-c9eb-4682-8da3-156816589988 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:10.030638 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-32982346-c9eb-4682-8da3-156816589988 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:10.038537 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-32982346-c9eb-4682-8da3-156816589988 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.151448 Aug 05 02:21:10.039031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 66/132] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:09 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:10.080073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d617008f-b1d2-41ba-bdba-f8ded5781fdb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:10.080725 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d617008f-b1d2-41ba-bdba-f8ded5781fdb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:10.086576 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d617008f-b1d2-41ba-bdba-f8ded5781fdb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:10.087050 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d617008f-b1d2-41ba-bdba-f8ded5781fdb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:10.087482 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d617008f-b1d2-41ba-bdba-f8ded5781fdb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:10.088184 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d617008f-b1d2-41ba-bdba-f8ded5781fdb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:10.088655 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d617008f-b1d2-41ba-bdba-f8ded5781fdb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:10.089076 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d617008f-b1d2-41ba-bdba-f8ded5781fdb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:10.218197 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d617008f-b1d2-41ba-bdba-f8ded5781fdb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:10.225924 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-43f15dac-276d-4c57-a6a1-279b40df9e4a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:10.226069 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d617008f-b1d2-41ba-bdba-f8ded5781fdb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.149682 Aug 05 02:21:10.226513 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 67/133] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:10 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:10.226613 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-43f15dac-276d-4c57-a6a1-279b40df9e4a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:10.233114 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43f15dac-276d-4c57-a6a1-279b40df9e4a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:10.233554 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43f15dac-276d-4c57-a6a1-279b40df9e4a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:10.233957 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43f15dac-276d-4c57-a6a1-279b40df9e4a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:10.234642 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43f15dac-276d-4c57-a6a1-279b40df9e4a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:10.235094 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43f15dac-276d-4c57-a6a1-279b40df9e4a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:10.235521 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43f15dac-276d-4c57-a6a1-279b40df9e4a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:10.364587 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-43f15dac-276d-4c57-a6a1-279b40df9e4a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:10.366781 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c55b8296-bd85-4396-8bea-a4774aeddf37 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:10.367395 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c55b8296-bd85-4396-8bea-a4774aeddf37 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:10.372626 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-43f15dac-276d-4c57-a6a1-279b40df9e4a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:10.373174 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c55b8296-bd85-4396-8bea-a4774aeddf37 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:10.373680 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c55b8296-bd85-4396-8bea-a4774aeddf37 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:10.374106 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c55b8296-bd85-4396-8bea-a4774aeddf37 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:10.374209 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-43f15dac-276d-4c57-a6a1-279b40df9e4a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:10.374785 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c55b8296-bd85-4396-8bea-a4774aeddf37 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:10.375230 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c55b8296-bd85-4396-8bea-a4774aeddf37 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:10.375362 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-43f15dac-276d-4c57-a6a1-279b40df9e4a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.153215 Aug 05 02:21:10.375645 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c55b8296-bd85-4396-8bea-a4774aeddf37 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:10.375854 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 67/134] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:10 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:21:10.393641 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:10.506262 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c55b8296-bd85-4396-8bea-a4774aeddf37 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:10.513567 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c55b8296-bd85-4396-8bea-a4774aeddf37 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.150479 Aug 05 02:21:10.514761 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 68/135] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:10 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:10.860672 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a3bee4f7-e71e-4345-a967-cd5880193b88 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:10.861285 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a3bee4f7-e71e-4345-a967-cd5880193b88 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:10.867191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a3bee4f7-e71e-4345-a967-cd5880193b88 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:10.867678 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a3bee4f7-e71e-4345-a967-cd5880193b88 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:10.868113 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a3bee4f7-e71e-4345-a967-cd5880193b88 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:10.868921 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a3bee4f7-e71e-4345-a967-cd5880193b88 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:10.869376 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a3bee4f7-e71e-4345-a967-cd5880193b88 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:10.869800 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a3bee4f7-e71e-4345-a967-cd5880193b88 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:11.007432 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a3bee4f7-e71e-4345-a967-cd5880193b88 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:11.015562 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a3bee4f7-e71e-4345-a967-cd5880193b88 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.158812 Aug 05 02:21:11.016134 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 68/136] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:10 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:11.059467 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fcea1d2f-85ed-4c1f-8349-7a0b12a78eaa tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:11.060082 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fcea1d2f-85ed-4c1f-8349-7a0b12a78eaa tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:11.067505 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fcea1d2f-85ed-4c1f-8349-7a0b12a78eaa tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:11.068362 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fcea1d2f-85ed-4c1f-8349-7a0b12a78eaa tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:11.068867 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fcea1d2f-85ed-4c1f-8349-7a0b12a78eaa tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:11.069595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fcea1d2f-85ed-4c1f-8349-7a0b12a78eaa tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:11.070049 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fcea1d2f-85ed-4c1f-8349-7a0b12a78eaa tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:11.070474 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fcea1d2f-85ed-4c1f-8349-7a0b12a78eaa tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:11.205259 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fcea1d2f-85ed-4c1f-8349-7a0b12a78eaa tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:11.213265 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fcea1d2f-85ed-4c1f-8349-7a0b12a78eaa tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.157611 Aug 05 02:21:11.213824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 69/137] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:11 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:11.246625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d215ad05-2a2d-4b17-b7a8-68ab962e06d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:11.247225 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d215ad05-2a2d-4b17-b7a8-68ab962e06d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:11.253688 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d215ad05-2a2d-4b17-b7a8-68ab962e06d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:11.254160 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d215ad05-2a2d-4b17-b7a8-68ab962e06d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:11.254591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d215ad05-2a2d-4b17-b7a8-68ab962e06d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:11.255262 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d215ad05-2a2d-4b17-b7a8-68ab962e06d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:11.255715 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d215ad05-2a2d-4b17-b7a8-68ab962e06d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:11.256130 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d215ad05-2a2d-4b17-b7a8-68ab962e06d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:11.384622 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d215ad05-2a2d-4b17-b7a8-68ab962e06d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:11.392725 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d215ad05-2a2d-4b17-b7a8-68ab962e06d3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.149824 Aug 05 02:21:11.393285 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 69/138] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:11 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:11.397991 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0352aa25-a291-4fd4-a812-9dbe9363a433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:11.398596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0352aa25-a291-4fd4-a812-9dbe9363a433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:11.405097 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0352aa25-a291-4fd4-a812-9dbe9363a433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:11.405621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0352aa25-a291-4fd4-a812-9dbe9363a433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:11.406121 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0352aa25-a291-4fd4-a812-9dbe9363a433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:11.406808 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0352aa25-a291-4fd4-a812-9dbe9363a433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:11.407258 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0352aa25-a291-4fd4-a812-9dbe9363a433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:11.407962 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0352aa25-a291-4fd4-a812-9dbe9363a433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:11.535478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-386b52f1-70ae-4037-88c7-a4304f25f09a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:11.536086 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-386b52f1-70ae-4037-88c7-a4304f25f09a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:11.539462 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0352aa25-a291-4fd4-a812-9dbe9363a433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:11.542056 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-386b52f1-70ae-4037-88c7-a4304f25f09a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:11.542541 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-386b52f1-70ae-4037-88c7-a4304f25f09a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:11.542985 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-386b52f1-70ae-4037-88c7-a4304f25f09a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:11.543679 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-386b52f1-70ae-4037-88c7-a4304f25f09a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:11.544132 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-386b52f1-70ae-4037-88c7-a4304f25f09a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:11.544586 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-386b52f1-70ae-4037-88c7-a4304f25f09a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:11.547771 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0352aa25-a291-4fd4-a812-9dbe9363a433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:11.549296 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0352aa25-a291-4fd4-a812-9dbe9363a433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:11.550393 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0352aa25-a291-4fd4-a812-9dbe9363a433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.156354 Aug 05 02:21:11.550951 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 70/139] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:11 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:21:11.734353 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-386b52f1-70ae-4037-88c7-a4304f25f09a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:11.749028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-386b52f1-70ae-4037-88c7-a4304f25f09a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.216686 Aug 05 02:21:11.750219 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 70/140] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:11 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:12.041314 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3c6fe36e-0037-4929-8606-1df0970efccf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:12.041922 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3c6fe36e-0037-4929-8606-1df0970efccf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:12.049418 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c6fe36e-0037-4929-8606-1df0970efccf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:12.049977 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c6fe36e-0037-4929-8606-1df0970efccf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:12.050460 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c6fe36e-0037-4929-8606-1df0970efccf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:12.051149 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c6fe36e-0037-4929-8606-1df0970efccf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:12.051676 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c6fe36e-0037-4929-8606-1df0970efccf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:12.052104 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c6fe36e-0037-4929-8606-1df0970efccf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:12.188026 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3c6fe36e-0037-4929-8606-1df0970efccf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:12.195525 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3c6fe36e-0037-4929-8606-1df0970efccf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.158003 Aug 05 02:21:12.196100 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 71/141] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:12 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:12.234178 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3e62de8e-649d-4bfb-8dd0-6cba12b1e067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:12.234777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3e62de8e-649d-4bfb-8dd0-6cba12b1e067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:12.240728 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e62de8e-649d-4bfb-8dd0-6cba12b1e067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:12.241146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e62de8e-649d-4bfb-8dd0-6cba12b1e067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:12.241574 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e62de8e-649d-4bfb-8dd0-6cba12b1e067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:12.242249 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e62de8e-649d-4bfb-8dd0-6cba12b1e067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:12.242692 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e62de8e-649d-4bfb-8dd0-6cba12b1e067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:12.243106 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e62de8e-649d-4bfb-8dd0-6cba12b1e067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:12.372476 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3e62de8e-649d-4bfb-8dd0-6cba12b1e067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:12.380724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3e62de8e-649d-4bfb-8dd0-6cba12b1e067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.150940 Aug 05 02:21:12.381294 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 71/142] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:12 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:12.414082 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f9acad25-e041-4b26-b313-e53ededc058c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:12.414686 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f9acad25-e041-4b26-b313-e53ededc058c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:12.421527 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9acad25-e041-4b26-b313-e53ededc058c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:12.422000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9acad25-e041-4b26-b313-e53ededc058c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:12.422455 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9acad25-e041-4b26-b313-e53ededc058c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:12.423134 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9acad25-e041-4b26-b313-e53ededc058c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:12.423582 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9acad25-e041-4b26-b313-e53ededc058c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:12.423999 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9acad25-e041-4b26-b313-e53ededc058c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:12.550411 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f9acad25-e041-4b26-b313-e53ededc058c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:12.557709 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f9acad25-e041-4b26-b313-e53ededc058c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.147429 Aug 05 02:21:12.558273 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 72/143] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:12 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:12.572113 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-422628d3-a868-4533-9e0f-63943ae1a376 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:12.572752 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-422628d3-a868-4533-9e0f-63943ae1a376 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:12.580176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-422628d3-a868-4533-9e0f-63943ae1a376 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:12.580681 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-422628d3-a868-4533-9e0f-63943ae1a376 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:12.581118 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-422628d3-a868-4533-9e0f-63943ae1a376 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:12.581801 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-422628d3-a868-4533-9e0f-63943ae1a376 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:12.582256 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-422628d3-a868-4533-9e0f-63943ae1a376 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:12.582673 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-422628d3-a868-4533-9e0f-63943ae1a376 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:12.709772 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-422628d3-a868-4533-9e0f-63943ae1a376 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:12.718381 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-422628d3-a868-4533-9e0f-63943ae1a376 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:12.719874 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-422628d3-a868-4533-9e0f-63943ae1a376 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:12.720993 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-422628d3-a868-4533-9e0f-63943ae1a376 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.152772 Aug 05 02:21:12.721815 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 72/144] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:12 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:12.770321 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9e7462a6-fd02-41fb-8bb6-c103aa232ee3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:12.771092 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9e7462a6-fd02-41fb-8bb6-c103aa232ee3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:12.773991 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:12.777754 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e7462a6-fd02-41fb-8bb6-c103aa232ee3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:12.778233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e7462a6-fd02-41fb-8bb6-c103aa232ee3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:12.778664 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e7462a6-fd02-41fb-8bb6-c103aa232ee3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:12.779833 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e7462a6-fd02-41fb-8bb6-c103aa232ee3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:12.780277 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e7462a6-fd02-41fb-8bb6-c103aa232ee3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:12.780893 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e7462a6-fd02-41fb-8bb6-c103aa232ee3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:12.911157 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9e7462a6-fd02-41fb-8bb6-c103aa232ee3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:12.918453 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9e7462a6-fd02-41fb-8bb6-c103aa232ee3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.151919 Aug 05 02:21:12.919011 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 73/145] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:12 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:13.214903 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d5559e90-2e82-4f70-9a78-267c4c80db62 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:13.215700 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d5559e90-2e82-4f70-9a78-267c4c80db62 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:13.223099 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5559e90-2e82-4f70-9a78-267c4c80db62 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:13.223577 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5559e90-2e82-4f70-9a78-267c4c80db62 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:13.224005 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5559e90-2e82-4f70-9a78-267c4c80db62 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:13.224721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5559e90-2e82-4f70-9a78-267c4c80db62 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:13.225171 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5559e90-2e82-4f70-9a78-267c4c80db62 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:13.225590 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5559e90-2e82-4f70-9a78-267c4c80db62 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:13.355657 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d5559e90-2e82-4f70-9a78-267c4c80db62 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:13.363067 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d5559e90-2e82-4f70-9a78-267c4c80db62 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.151980 Aug 05 02:21:13.363656 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 73/146] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:13 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:13.401217 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ae5fc013-73b0-4363-a612-54f5e888a1d6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:13.401859 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ae5fc013-73b0-4363-a612-54f5e888a1d6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:13.408002 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae5fc013-73b0-4363-a612-54f5e888a1d6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:13.408529 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae5fc013-73b0-4363-a612-54f5e888a1d6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:13.408962 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae5fc013-73b0-4363-a612-54f5e888a1d6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:13.409743 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae5fc013-73b0-4363-a612-54f5e888a1d6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:13.410376 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae5fc013-73b0-4363-a612-54f5e888a1d6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:13.410888 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae5fc013-73b0-4363-a612-54f5e888a1d6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:13.536821 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ae5fc013-73b0-4363-a612-54f5e888a1d6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:13.544014 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ae5fc013-73b0-4363-a612-54f5e888a1d6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.146632 Aug 05 02:21:13.544614 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 74/147] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:13 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:13.579693 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-13e05f56-9df4-4005-8380-f07a39b86ac5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:13.580181 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-13e05f56-9df4-4005-8380-f07a39b86ac5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:13.586175 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13e05f56-9df4-4005-8380-f07a39b86ac5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:13.586669 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13e05f56-9df4-4005-8380-f07a39b86ac5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:13.587106 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13e05f56-9df4-4005-8380-f07a39b86ac5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:13.587800 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13e05f56-9df4-4005-8380-f07a39b86ac5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:13.588256 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13e05f56-9df4-4005-8380-f07a39b86ac5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:13.588707 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13e05f56-9df4-4005-8380-f07a39b86ac5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:13.714821 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-13e05f56-9df4-4005-8380-f07a39b86ac5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:13.723026 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-13e05f56-9df4-4005-8380-f07a39b86ac5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.148384 Aug 05 02:21:13.723592 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 74/148] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:13 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:13.742996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1441ef33-44b6-431a-ad66-8c99ac9f83e0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:13.743580 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1441ef33-44b6-431a-ad66-8c99ac9f83e0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:13.749584 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1441ef33-44b6-431a-ad66-8c99ac9f83e0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:13.750055 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1441ef33-44b6-431a-ad66-8c99ac9f83e0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:13.750477 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1441ef33-44b6-431a-ad66-8c99ac9f83e0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:13.751147 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1441ef33-44b6-431a-ad66-8c99ac9f83e0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:13.751592 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1441ef33-44b6-431a-ad66-8c99ac9f83e0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:13.752004 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1441ef33-44b6-431a-ad66-8c99ac9f83e0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:13.890704 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1441ef33-44b6-431a-ad66-8c99ac9f83e0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:13.898594 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1441ef33-44b6-431a-ad66-8c99ac9f83e0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:13.900089 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1441ef33-44b6-431a-ad66-8c99ac9f83e0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:13.901213 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1441ef33-44b6-431a-ad66-8c99ac9f83e0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.162170 Aug 05 02:21:13.901776 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 75/149] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:13 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:13.939219 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bb8eead8-7712-4c84-a325-501754d68ba7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:13.939851 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bb8eead8-7712-4c84-a325-501754d68ba7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:13.945772 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb8eead8-7712-4c84-a325-501754d68ba7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:13.946251 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb8eead8-7712-4c84-a325-501754d68ba7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:13.946745 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb8eead8-7712-4c84-a325-501754d68ba7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:13.947426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb8eead8-7712-4c84-a325-501754d68ba7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:13.947880 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb8eead8-7712-4c84-a325-501754d68ba7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:13.948304 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb8eead8-7712-4c84-a325-501754d68ba7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:14.079662 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bb8eead8-7712-4c84-a325-501754d68ba7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:14.087055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bb8eead8-7712-4c84-a325-501754d68ba7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.151606 Aug 05 02:21:14.087545 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 75/150] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:13 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:14.383279 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6c86c152-7b14-4fc7-afd7-19ab331f35d5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:14.383797 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6c86c152-7b14-4fc7-afd7-19ab331f35d5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:14.390412 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c86c152-7b14-4fc7-afd7-19ab331f35d5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:14.390883 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c86c152-7b14-4fc7-afd7-19ab331f35d5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:14.391305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c86c152-7b14-4fc7-afd7-19ab331f35d5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:14.391976 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c86c152-7b14-4fc7-afd7-19ab331f35d5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:14.392441 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c86c152-7b14-4fc7-afd7-19ab331f35d5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:14.392857 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c86c152-7b14-4fc7-afd7-19ab331f35d5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:14.516835 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6c86c152-7b14-4fc7-afd7-19ab331f35d5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:14.524131 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6c86c152-7b14-4fc7-afd7-19ab331f35d5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.144709 Aug 05 02:21:14.524734 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 76/151] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:14 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:14.565265 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-28cd2de9-3291-4949-8194-4755b403fae0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:14.565863 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-28cd2de9-3291-4949-8194-4755b403fae0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:14.571698 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28cd2de9-3291-4949-8194-4755b403fae0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:14.572170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28cd2de9-3291-4949-8194-4755b403fae0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:14.572627 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28cd2de9-3291-4949-8194-4755b403fae0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:14.573300 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28cd2de9-3291-4949-8194-4755b403fae0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:14.573744 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28cd2de9-3291-4949-8194-4755b403fae0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:14.574163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28cd2de9-3291-4949-8194-4755b403fae0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:14.700784 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-28cd2de9-3291-4949-8194-4755b403fae0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:14.708174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-28cd2de9-3291-4949-8194-4755b403fae0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.147569 Aug 05 02:21:14.708780 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 76/152] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:14 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:14.744181 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-83096912-38ac-49a1-b691-4ed5307598a5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:14.747515 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-83096912-38ac-49a1-b691-4ed5307598a5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:14.756302 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83096912-38ac-49a1-b691-4ed5307598a5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:14.756819 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83096912-38ac-49a1-b691-4ed5307598a5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:14.757261 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83096912-38ac-49a1-b691-4ed5307598a5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:14.757945 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83096912-38ac-49a1-b691-4ed5307598a5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:14.758396 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83096912-38ac-49a1-b691-4ed5307598a5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:14.758818 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83096912-38ac-49a1-b691-4ed5307598a5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:14.891804 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-83096912-38ac-49a1-b691-4ed5307598a5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:14.899924 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-83096912-38ac-49a1-b691-4ed5307598a5 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.159428 Aug 05 02:21:14.908553 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 77/153] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:14 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:14.923972 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f29ecaa9-a5b5-4a81-bbf4-3d9e8b3a6ba8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:14.924605 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f29ecaa9-a5b5-4a81-bbf4-3d9e8b3a6ba8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:14.930452 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f29ecaa9-a5b5-4a81-bbf4-3d9e8b3a6ba8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:14.931089 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f29ecaa9-a5b5-4a81-bbf4-3d9e8b3a6ba8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:14.931524 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f29ecaa9-a5b5-4a81-bbf4-3d9e8b3a6ba8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:14.932195 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f29ecaa9-a5b5-4a81-bbf4-3d9e8b3a6ba8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:14.932817 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f29ecaa9-a5b5-4a81-bbf4-3d9e8b3a6ba8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:14.933241 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f29ecaa9-a5b5-4a81-bbf4-3d9e8b3a6ba8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:15.066782 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f29ecaa9-a5b5-4a81-bbf4-3d9e8b3a6ba8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:15.074650 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f29ecaa9-a5b5-4a81-bbf4-3d9e8b3a6ba8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:15.077029 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f29ecaa9-a5b5-4a81-bbf4-3d9e8b3a6ba8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:15.078162 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f29ecaa9-a5b5-4a81-bbf4-3d9e8b3a6ba8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.158604 Aug 05 02:21:15.078722 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 77/154] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:14 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:15.108748 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-248c2214-01c8-4b14-8829-e2536f8674d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:15.109354 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-248c2214-01c8-4b14-8829-e2536f8674d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:15.115334 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-248c2214-01c8-4b14-8829-e2536f8674d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:15.115809 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-248c2214-01c8-4b14-8829-e2536f8674d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:15.116240 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-248c2214-01c8-4b14-8829-e2536f8674d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:15.116945 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-248c2214-01c8-4b14-8829-e2536f8674d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:15.117393 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-248c2214-01c8-4b14-8829-e2536f8674d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:15.117812 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-248c2214-01c8-4b14-8829-e2536f8674d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:15.250142 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-248c2214-01c8-4b14-8829-e2536f8674d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:15.257534 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-248c2214-01c8-4b14-8829-e2536f8674d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.153198 Aug 05 02:21:15.258096 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 78/155] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:15 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:15.544366 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-22be156a-a1c2-4793-876d-04c2e8ce60fb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:15.545599 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-22be156a-a1c2-4793-876d-04c2e8ce60fb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:15.548465 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:15.552220 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22be156a-a1c2-4793-876d-04c2e8ce60fb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:15.552718 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22be156a-a1c2-4793-876d-04c2e8ce60fb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:15.553146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22be156a-a1c2-4793-876d-04c2e8ce60fb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:15.553821 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22be156a-a1c2-4793-876d-04c2e8ce60fb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:15.554262 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22be156a-a1c2-4793-876d-04c2e8ce60fb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:15.554677 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22be156a-a1c2-4793-876d-04c2e8ce60fb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:15.681778 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-22be156a-a1c2-4793-876d-04c2e8ce60fb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:15.690939 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-22be156a-a1c2-4793-876d-04c2e8ce60fb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.150450 Aug 05 02:21:15.691506 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 78/156] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:15 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:15.728916 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cbb7013a-1626-4758-994b-414cf9fad452 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:15.729726 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cbb7013a-1626-4758-994b-414cf9fad452 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:15.737226 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbb7013a-1626-4758-994b-414cf9fad452 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:15.737936 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbb7013a-1626-4758-994b-414cf9fad452 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:15.738491 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbb7013a-1626-4758-994b-414cf9fad452 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:15.739180 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbb7013a-1626-4758-994b-414cf9fad452 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:15.739745 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbb7013a-1626-4758-994b-414cf9fad452 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:15.740421 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbb7013a-1626-4758-994b-414cf9fad452 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:15.870331 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cbb7013a-1626-4758-994b-414cf9fad452 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:15.877824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cbb7013a-1626-4758-994b-414cf9fad452 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.152710 Aug 05 02:21:15.878384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 79/157] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:15 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:15.921691 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-872bf7be-af82-4e93-b398-1531269adf40 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:15.922297 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-872bf7be-af82-4e93-b398-1531269adf40 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:15.928181 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-872bf7be-af82-4e93-b398-1531269adf40 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:15.928700 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-872bf7be-af82-4e93-b398-1531269adf40 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:15.929135 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-872bf7be-af82-4e93-b398-1531269adf40 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:15.929821 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-872bf7be-af82-4e93-b398-1531269adf40 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:15.930270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-872bf7be-af82-4e93-b398-1531269adf40 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:15.930690 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-872bf7be-af82-4e93-b398-1531269adf40 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:16.059390 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-872bf7be-af82-4e93-b398-1531269adf40 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:16.067474 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-872bf7be-af82-4e93-b398-1531269adf40 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.150269 Aug 05 02:21:16.067977 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 79/158] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:15 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:16.099716 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2b965473-e372-41d3-93b2-215df55fbc74 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:16.100448 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2b965473-e372-41d3-93b2-215df55fbc74 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:16.106195 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2b965473-e372-41d3-93b2-215df55fbc74 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:16.106675 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2b965473-e372-41d3-93b2-215df55fbc74 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:16.107111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2b965473-e372-41d3-93b2-215df55fbc74 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:16.108377 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2b965473-e372-41d3-93b2-215df55fbc74 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:16.108835 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2b965473-e372-41d3-93b2-215df55fbc74 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:16.109259 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2b965473-e372-41d3-93b2-215df55fbc74 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:16.240357 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2b965473-e372-41d3-93b2-215df55fbc74 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:16.248152 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2b965473-e372-41d3-93b2-215df55fbc74 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:16.249673 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2b965473-e372-41d3-93b2-215df55fbc74 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:16.250755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2b965473-e372-41d3-93b2-215df55fbc74 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.155247 Aug 05 02:21:16.251299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 80/159] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:16 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:16.278623 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8278bc83-d91b-4c5c-a647-4ee02ffa2914 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:16.280035 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8278bc83-d91b-4c5c-a647-4ee02ffa2914 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:16.285926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8278bc83-d91b-4c5c-a647-4ee02ffa2914 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:16.286405 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8278bc83-d91b-4c5c-a647-4ee02ffa2914 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:16.286837 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8278bc83-d91b-4c5c-a647-4ee02ffa2914 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:16.287516 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8278bc83-d91b-4c5c-a647-4ee02ffa2914 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:16.287963 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8278bc83-d91b-4c5c-a647-4ee02ffa2914 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:16.288404 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8278bc83-d91b-4c5c-a647-4ee02ffa2914 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:16.420893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8278bc83-d91b-4c5c-a647-4ee02ffa2914 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:16.428120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8278bc83-d91b-4c5c-a647-4ee02ffa2914 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.153243 Aug 05 02:21:16.428711 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 80/160] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:16 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:16.711628 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5e33e0bd-23f2-4ea5-a97b-cb98a490451b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:16.712599 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5e33e0bd-23f2-4ea5-a97b-cb98a490451b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:16.720731 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e33e0bd-23f2-4ea5-a97b-cb98a490451b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:16.721676 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e33e0bd-23f2-4ea5-a97b-cb98a490451b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:16.722198 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e33e0bd-23f2-4ea5-a97b-cb98a490451b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:16.723036 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e33e0bd-23f2-4ea5-a97b-cb98a490451b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:16.723669 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e33e0bd-23f2-4ea5-a97b-cb98a490451b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:16.724382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e33e0bd-23f2-4ea5-a97b-cb98a490451b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:16.862850 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5e33e0bd-23f2-4ea5-a97b-cb98a490451b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:16.870360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5e33e0bd-23f2-4ea5-a97b-cb98a490451b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.162633 Aug 05 02:21:16.870923 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 81/161] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:16 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:16.897759 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-48948cab-089b-48d3-99f9-27193a33753c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:16.898549 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-48948cab-089b-48d3-99f9-27193a33753c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:16.904504 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48948cab-089b-48d3-99f9-27193a33753c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:16.905103 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48948cab-089b-48d3-99f9-27193a33753c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:16.905538 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48948cab-089b-48d3-99f9-27193a33753c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:16.906215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48948cab-089b-48d3-99f9-27193a33753c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:16.906658 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48948cab-089b-48d3-99f9-27193a33753c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:16.907073 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48948cab-089b-48d3-99f9-27193a33753c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:17.034195 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-48948cab-089b-48d3-99f9-27193a33753c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:17.037572 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:17.042481 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-48948cab-089b-48d3-99f9-27193a33753c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.148783 Aug 05 02:21:17.043195 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 81/162] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:16 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:17.088839 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5c894b3a-f78b-48c9-8e57-f76938415a43 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:17.089547 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5c894b3a-f78b-48c9-8e57-f76938415a43 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:17.095954 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c894b3a-f78b-48c9-8e57-f76938415a43 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:17.096719 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c894b3a-f78b-48c9-8e57-f76938415a43 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:17.097144 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c894b3a-f78b-48c9-8e57-f76938415a43 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:17.097853 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c894b3a-f78b-48c9-8e57-f76938415a43 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:17.098301 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c894b3a-f78b-48c9-8e57-f76938415a43 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:17.098714 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c894b3a-f78b-48c9-8e57-f76938415a43 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:17.248716 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5c894b3a-f78b-48c9-8e57-f76938415a43 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:17.256416 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5c894b3a-f78b-48c9-8e57-f76938415a43 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.171285 Aug 05 02:21:17.257015 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 82/163] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:17 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:17.274154 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1b6056c8-5049-459a-9a16-7d28fdf2abd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:17.274761 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1b6056c8-5049-459a-9a16-7d28fdf2abd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:17.282109 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b6056c8-5049-459a-9a16-7d28fdf2abd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:17.282599 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b6056c8-5049-459a-9a16-7d28fdf2abd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:17.283240 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b6056c8-5049-459a-9a16-7d28fdf2abd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:17.283943 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b6056c8-5049-459a-9a16-7d28fdf2abd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:17.284434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b6056c8-5049-459a-9a16-7d28fdf2abd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:17.284865 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b6056c8-5049-459a-9a16-7d28fdf2abd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:17.426205 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1b6056c8-5049-459a-9a16-7d28fdf2abd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:17.434494 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1b6056c8-5049-459a-9a16-7d28fdf2abd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:17.436584 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1b6056c8-5049-459a-9a16-7d28fdf2abd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:17.437674 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1b6056c8-5049-459a-9a16-7d28fdf2abd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.167869 Aug 05 02:21:17.438225 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 82/164] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:17 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:21:17.449029 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a221f82e-bc85-4769-a36d-54898f1de751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:17.449719 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a221f82e-bc85-4769-a36d-54898f1de751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:17.457400 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a221f82e-bc85-4769-a36d-54898f1de751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:17.457883 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a221f82e-bc85-4769-a36d-54898f1de751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:17.458313 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a221f82e-bc85-4769-a36d-54898f1de751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:17.459003 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a221f82e-bc85-4769-a36d-54898f1de751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:17.459457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a221f82e-bc85-4769-a36d-54898f1de751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:17.459891 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a221f82e-bc85-4769-a36d-54898f1de751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:17.589701 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a221f82e-bc85-4769-a36d-54898f1de751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:17.598107 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a221f82e-bc85-4769-a36d-54898f1de751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.153289 Aug 05 02:21:17.598669 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 83/165] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:17 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:17.892767 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3bb8b7b3-5989-4081-8de8-1e48f2b35338 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:17.893368 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3bb8b7b3-5989-4081-8de8-1e48f2b35338 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:17.899534 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bb8b7b3-5989-4081-8de8-1e48f2b35338 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:17.900120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bb8b7b3-5989-4081-8de8-1e48f2b35338 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:17.900503 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bb8b7b3-5989-4081-8de8-1e48f2b35338 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:17.901196 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bb8b7b3-5989-4081-8de8-1e48f2b35338 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:17.901651 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bb8b7b3-5989-4081-8de8-1e48f2b35338 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:17.902095 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bb8b7b3-5989-4081-8de8-1e48f2b35338 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:18.030068 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3bb8b7b3-5989-4081-8de8-1e48f2b35338 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:18.037396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3bb8b7b3-5989-4081-8de8-1e48f2b35338 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.149571 Aug 05 02:21:18.037956 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 83/166] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:17 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:18.063973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cc1b5e75-342b-4bb5-ab1e-1162ca4d97de tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:18.064673 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cc1b5e75-342b-4bb5-ab1e-1162ca4d97de tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:18.070933 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc1b5e75-342b-4bb5-ab1e-1162ca4d97de tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:18.071423 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc1b5e75-342b-4bb5-ab1e-1162ca4d97de tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:18.071911 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc1b5e75-342b-4bb5-ab1e-1162ca4d97de tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:18.072610 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc1b5e75-342b-4bb5-ab1e-1162ca4d97de tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:18.073065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc1b5e75-342b-4bb5-ab1e-1162ca4d97de tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:18.073530 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cc1b5e75-342b-4bb5-ab1e-1162ca4d97de tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:18.204353 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cc1b5e75-342b-4bb5-ab1e-1162ca4d97de tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:18.211799 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cc1b5e75-342b-4bb5-ab1e-1162ca4d97de tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.152798 Aug 05 02:21:18.212383 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 84/167] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:18 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:18.276839 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e9a1168b-f313-47a5-b97e-cdc93dffaeac tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:18.277361 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e9a1168b-f313-47a5-b97e-cdc93dffaeac tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:18.284038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9a1168b-f313-47a5-b97e-cdc93dffaeac tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:18.284552 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9a1168b-f313-47a5-b97e-cdc93dffaeac tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:18.284981 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9a1168b-f313-47a5-b97e-cdc93dffaeac tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:18.285837 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9a1168b-f313-47a5-b97e-cdc93dffaeac tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:18.286287 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9a1168b-f313-47a5-b97e-cdc93dffaeac tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:18.286707 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9a1168b-f313-47a5-b97e-cdc93dffaeac tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:18.461683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3d601f4e-5567-4461-ac90-96e4d25ae07b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:18.462494 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3d601f4e-5567-4461-ac90-96e4d25ae07b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:18.468269 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e9a1168b-f313-47a5-b97e-cdc93dffaeac tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:18.486192 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d601f4e-5567-4461-ac90-96e4d25ae07b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:18.486855 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e9a1168b-f313-47a5-b97e-cdc93dffaeac tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.211252 Aug 05 02:21:18.488018 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d601f4e-5567-4461-ac90-96e4d25ae07b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:18.488492 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 84/168] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:18 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:18.489204 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d601f4e-5567-4461-ac90-96e4d25ae07b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:18.490174 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d601f4e-5567-4461-ac90-96e4d25ae07b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:18.491442 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d601f4e-5567-4461-ac90-96e4d25ae07b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:18.492208 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d601f4e-5567-4461-ac90-96e4d25ae07b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:18.499469 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:18.620451 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d39c22da-f12a-4825-a4bc-7ece2bb97f3d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:18.621070 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d39c22da-f12a-4825-a4bc-7ece2bb97f3d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:18.642860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d39c22da-f12a-4825-a4bc-7ece2bb97f3d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:18.643361 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d39c22da-f12a-4825-a4bc-7ece2bb97f3d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:18.643793 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d39c22da-f12a-4825-a4bc-7ece2bb97f3d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:18.644525 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d39c22da-f12a-4825-a4bc-7ece2bb97f3d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:18.645091 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d39c22da-f12a-4825-a4bc-7ece2bb97f3d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:18.645380 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d39c22da-f12a-4825-a4bc-7ece2bb97f3d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:18.867580 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d39c22da-f12a-4825-a4bc-7ece2bb97f3d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:18.878330 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d39c22da-f12a-4825-a4bc-7ece2bb97f3d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.263834 Aug 05 02:21:18.879299 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 85/169] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:18 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:19.020917 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3d601f4e-5567-4461-ac90-96e4d25ae07b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:19.032667 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3d601f4e-5567-4461-ac90-96e4d25ae07b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:19.034268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3d601f4e-5567-4461-ac90-96e4d25ae07b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:19.035510 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3d601f4e-5567-4461-ac90-96e4d25ae07b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.578909 Aug 05 02:21:19.036709 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 85/170] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:18 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:21:19.058496 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-baf90add-8817-4e17-8e1a-14f42fc5ef8d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:19.059918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-baf90add-8817-4e17-8e1a-14f42fc5ef8d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:19.071736 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baf90add-8817-4e17-8e1a-14f42fc5ef8d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:19.073378 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baf90add-8817-4e17-8e1a-14f42fc5ef8d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:19.073819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baf90add-8817-4e17-8e1a-14f42fc5ef8d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:19.077063 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baf90add-8817-4e17-8e1a-14f42fc5ef8d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:19.077723 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baf90add-8817-4e17-8e1a-14f42fc5ef8d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:19.078159 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baf90add-8817-4e17-8e1a-14f42fc5ef8d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:19.234457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-63237838-6354-44ca-814a-501b094fef17 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:19.235067 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-63237838-6354-44ca-814a-501b094fef17 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:19.243575 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63237838-6354-44ca-814a-501b094fef17 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:19.244072 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63237838-6354-44ca-814a-501b094fef17 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:19.248872 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63237838-6354-44ca-814a-501b094fef17 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:19.249938 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63237838-6354-44ca-814a-501b094fef17 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:19.250568 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63237838-6354-44ca-814a-501b094fef17 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:19.251138 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63237838-6354-44ca-814a-501b094fef17 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:19.363319 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-baf90add-8817-4e17-8e1a-14f42fc5ef8d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:19.371741 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-baf90add-8817-4e17-8e1a-14f42fc5ef8d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.317133 Aug 05 02:21:19.376261 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 86/171] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:19 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:19.477066 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-63237838-6354-44ca-814a-501b094fef17 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:19.490494 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-63237838-6354-44ca-814a-501b094fef17 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.260146 Aug 05 02:21:19.491111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 86/172] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:19 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:19.510512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-761e90dd-ab3b-4e52-86a2-f95b4a4f0b71 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:19.511124 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-761e90dd-ab3b-4e52-86a2-f95b4a4f0b71 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:19.520620 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-761e90dd-ab3b-4e52-86a2-f95b4a4f0b71 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:19.521116 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-761e90dd-ab3b-4e52-86a2-f95b4a4f0b71 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:19.521711 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-761e90dd-ab3b-4e52-86a2-f95b4a4f0b71 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:19.523791 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-761e90dd-ab3b-4e52-86a2-f95b4a4f0b71 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:19.524788 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-761e90dd-ab3b-4e52-86a2-f95b4a4f0b71 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:19.525415 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-761e90dd-ab3b-4e52-86a2-f95b4a4f0b71 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:19.525717 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-3e45d975-bb12-44b4-8496-86abe2871cb7 req-1be14a2f-46fc-42d2-9145-997203b19b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a387642-9e46-4a64-8017-43786f426b70", "name": "network-vif-plugged", "status": "completed", "tag": "7885d180-df69-43cf-b111-f789955314dc"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:21:19.548443 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3e45d975-bb12-44b4-8496-86abe2871cb7 req-1be14a2f-46fc-42d2-9145-997203b19b3d service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:19.548927 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3e45d975-bb12-44b4-8496-86abe2871cb7 req-1be14a2f-46fc-42d2-9145-997203b19b3d service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:19.549348 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3e45d975-bb12-44b4-8496-86abe2871cb7 req-1be14a2f-46fc-42d2-9145-997203b19b3d service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:19.573400 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-3e45d975-bb12-44b4-8496-86abe2871cb7 req-1be14a2f-46fc-42d2-9145-997203b19b3d service nova] Creating event network-vif-plugged:7885d180-df69-43cf-b111-f789955314dc for instance 1a387642-9e46-4a64-8017-43786f426b70 on hv-cinder-81558 Aug 05 02:21:19.581171 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-3e45d975-bb12-44b4-8496-86abe2871cb7 req-1be14a2f-46fc-42d2-9145-997203b19b3d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189662 Aug 05 02:21:19.582449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 87/173] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:21:19.690839 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-761e90dd-ab3b-4e52-86a2-f95b4a4f0b71 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:19.698267 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-761e90dd-ab3b-4e52-86a2-f95b4a4f0b71 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.191560 Aug 05 02:21:19.698816 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 87/174] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:19 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:19.900860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ab1a6333-c7c9-40f0-b325-ab775e598442 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:19.901506 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ab1a6333-c7c9-40f0-b325-ab775e598442 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:19.908523 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab1a6333-c7c9-40f0-b325-ab775e598442 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:19.909004 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab1a6333-c7c9-40f0-b325-ab775e598442 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:19.909527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab1a6333-c7c9-40f0-b325-ab775e598442 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:19.910414 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab1a6333-c7c9-40f0-b325-ab775e598442 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:19.910923 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab1a6333-c7c9-40f0-b325-ab775e598442 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:19.911342 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab1a6333-c7c9-40f0-b325-ab775e598442 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:20.050671 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ab1a6333-c7c9-40f0-b325-ab775e598442 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:20.060163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ab1a6333-c7c9-40f0-b325-ab775e598442 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.163771 Aug 05 02:21:20.074294 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 88/175] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:19 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:20.074453 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6f300004-9730-419a-a032-d0b53c8e5834 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:20.074453 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6f300004-9730-419a-a032-d0b53c8e5834 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:20.074453 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f300004-9730-419a-a032-d0b53c8e5834 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:20.074453 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f300004-9730-419a-a032-d0b53c8e5834 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:20.074732 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f300004-9730-419a-a032-d0b53c8e5834 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:20.074732 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f300004-9730-419a-a032-d0b53c8e5834 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:20.074732 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f300004-9730-419a-a032-d0b53c8e5834 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:20.074732 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f300004-9730-419a-a032-d0b53c8e5834 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:20.216044 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6f300004-9730-419a-a032-d0b53c8e5834 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:20.227083 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6f300004-9730-419a-a032-d0b53c8e5834 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:20.229390 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6f300004-9730-419a-a032-d0b53c8e5834 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:20.230570 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6f300004-9730-419a-a032-d0b53c8e5834 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.175262 Aug 05 02:21:20.231121 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 88/176] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:20 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:21:20.397621 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0d1316ea-ffd9-4a77-a181-7a8f4eb5cd86 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:20.398266 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0d1316ea-ffd9-4a77-a181-7a8f4eb5cd86 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:20.405341 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d1316ea-ffd9-4a77-a181-7a8f4eb5cd86 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:20.406109 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d1316ea-ffd9-4a77-a181-7a8f4eb5cd86 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:20.406751 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d1316ea-ffd9-4a77-a181-7a8f4eb5cd86 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:20.407733 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d1316ea-ffd9-4a77-a181-7a8f4eb5cd86 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:20.408486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d1316ea-ffd9-4a77-a181-7a8f4eb5cd86 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:20.409227 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d1316ea-ffd9-4a77-a181-7a8f4eb5cd86 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:20.511508 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-98f1b841-9e06-48fa-9638-ca59d3e3bd3b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:20.512186 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-98f1b841-9e06-48fa-9638-ca59d3e3bd3b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:20.519399 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98f1b841-9e06-48fa-9638-ca59d3e3bd3b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:20.520223 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98f1b841-9e06-48fa-9638-ca59d3e3bd3b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:20.520920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98f1b841-9e06-48fa-9638-ca59d3e3bd3b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:20.521708 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98f1b841-9e06-48fa-9638-ca59d3e3bd3b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:20.522226 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98f1b841-9e06-48fa-9638-ca59d3e3bd3b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:20.522880 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98f1b841-9e06-48fa-9638-ca59d3e3bd3b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:20.669225 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0d1316ea-ffd9-4a77-a181-7a8f4eb5cd86 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:20.681564 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0d1316ea-ffd9-4a77-a181-7a8f4eb5cd86 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.287920 Aug 05 02:21:20.682620 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 89/177] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:20 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:20.704984 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-98f1b841-9e06-48fa-9638-ca59d3e3bd3b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:20.715168 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-98f1b841-9e06-48fa-9638-ca59d3e3bd3b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.207891 Aug 05 02:21:20.717160 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 89/178] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:20 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:20.719889 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-12db631a-2d40-4428-91a7-de94d55358a0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:20.720526 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-12db631a-2d40-4428-91a7-de94d55358a0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:20.730866 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12db631a-2d40-4428-91a7-de94d55358a0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:20.731421 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12db631a-2d40-4428-91a7-de94d55358a0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:20.732589 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12db631a-2d40-4428-91a7-de94d55358a0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:20.733765 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12db631a-2d40-4428-91a7-de94d55358a0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:20.734268 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12db631a-2d40-4428-91a7-de94d55358a0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:20.734816 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12db631a-2d40-4428-91a7-de94d55358a0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:21.084368 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bac7c8ab-c510-4755-a979-5481a0a3469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:21.085426 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bac7c8ab-c510-4755-a979-5481a0a3469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:21.097394 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bac7c8ab-c510-4755-a979-5481a0a3469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:21.097394 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bac7c8ab-c510-4755-a979-5481a0a3469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:21.098513 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bac7c8ab-c510-4755-a979-5481a0a3469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:21.099442 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bac7c8ab-c510-4755-a979-5481a0a3469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:21.100082 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bac7c8ab-c510-4755-a979-5481a0a3469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:21.100717 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bac7c8ab-c510-4755-a979-5481a0a3469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:21.365161 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-12db631a-2d40-4428-91a7-de94d55358a0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:21.383411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-12db631a-2d40-4428-91a7-de94d55358a0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.667717 Aug 05 02:21:21.384693 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 90/179] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:20 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:21.405636 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5e484906-4333-40d4-a4c2-9a04110499cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:21.406398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5e484906-4333-40d4-a4c2-9a04110499cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:21.412635 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e484906-4333-40d4-a4c2-9a04110499cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:21.413478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e484906-4333-40d4-a4c2-9a04110499cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:21.414098 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e484906-4333-40d4-a4c2-9a04110499cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:21.414862 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e484906-4333-40d4-a4c2-9a04110499cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:21.415369 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e484906-4333-40d4-a4c2-9a04110499cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:21.415995 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e484906-4333-40d4-a4c2-9a04110499cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:21.559467 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bac7c8ab-c510-4755-a979-5481a0a3469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:21.567498 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bac7c8ab-c510-4755-a979-5481a0a3469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.488219 Aug 05 02:21:21.568789 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 90/180] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:21 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:21.611926 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-cd54bbcc-5bad-4304-8fa9-ff95fd9f2069 req-4673011c-1e3d-4e3a-a3e9-d4abd7ec5860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "786487b8-f24e-4034-82da-c95e8efbf4e4", "name": "network-vif-plugged", "status": "completed", "tag": "7f1f18fd-2855-4e72-99d7-6356085d6879"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:21:21.629782 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-cd54bbcc-5bad-4304-8fa9-ff95fd9f2069 req-4673011c-1e3d-4e3a-a3e9-d4abd7ec5860 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:21.630576 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-cd54bbcc-5bad-4304-8fa9-ff95fd9f2069 req-4673011c-1e3d-4e3a-a3e9-d4abd7ec5860 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:21.631244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-cd54bbcc-5bad-4304-8fa9-ff95fd9f2069 req-4673011c-1e3d-4e3a-a3e9-d4abd7ec5860 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:21.650886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-cd54bbcc-5bad-4304-8fa9-ff95fd9f2069 req-4673011c-1e3d-4e3a-a3e9-d4abd7ec5860 service nova] Creating event network-vif-plugged:7f1f18fd-2855-4e72-99d7-6356085d6879 for instance 786487b8-f24e-4034-82da-c95e8efbf4e4 on hv-cinder-81558 Aug 05 02:21:21.660376 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-cd54bbcc-5bad-4304-8fa9-ff95fd9f2069 req-4673011c-1e3d-4e3a-a3e9-d4abd7ec5860 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057420 Aug 05 02:21:21.661832 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 91/181] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:21:21.705188 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-325df2a9-0eb7-4fda-9afc-4a264a3da1b2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:21.706380 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-325df2a9-0eb7-4fda-9afc-4a264a3da1b2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:21.714373 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5e484906-4333-40d4-a4c2-9a04110499cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:21.721589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-325df2a9-0eb7-4fda-9afc-4a264a3da1b2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:21.722943 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-325df2a9-0eb7-4fda-9afc-4a264a3da1b2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:21.723618 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-325df2a9-0eb7-4fda-9afc-4a264a3da1b2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:21.724747 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-325df2a9-0eb7-4fda-9afc-4a264a3da1b2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:21.725746 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-325df2a9-0eb7-4fda-9afc-4a264a3da1b2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:21.726649 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-325df2a9-0eb7-4fda-9afc-4a264a3da1b2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:21.727829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5e484906-4333-40d4-a4c2-9a04110499cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:21.729790 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5e484906-4333-40d4-a4c2-9a04110499cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:21.731406 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5e484906-4333-40d4-a4c2-9a04110499cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.333114 Aug 05 02:21:21.732692 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 91/182] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:21 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:21.739566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e2a008e7-339f-474d-a0d8-96c5e2c9c304 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:21.740470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e2a008e7-339f-474d-a0d8-96c5e2c9c304 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:21.746747 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2a008e7-339f-474d-a0d8-96c5e2c9c304 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:21.747994 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2a008e7-339f-474d-a0d8-96c5e2c9c304 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:21.748666 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2a008e7-339f-474d-a0d8-96c5e2c9c304 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:21.750714 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2a008e7-339f-474d-a0d8-96c5e2c9c304 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:21.751443 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2a008e7-339f-474d-a0d8-96c5e2c9c304 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:21.752179 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2a008e7-339f-474d-a0d8-96c5e2c9c304 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:21.968634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e2a008e7-339f-474d-a0d8-96c5e2c9c304 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:21.976815 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e2a008e7-339f-474d-a0d8-96c5e2c9c304 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.241198 Aug 05 02:21:21.979309 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 92/183] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:21 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:22.010933 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-325df2a9-0eb7-4fda-9afc-4a264a3da1b2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:22.026258 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-325df2a9-0eb7-4fda-9afc-4a264a3da1b2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.327777 Aug 05 02:21:22.026848 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 92/184] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:21 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:22.410832 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5ca5b0e6-a242-46da-b0c4-9674ed5a5219 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:22.412192 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5ca5b0e6-a242-46da-b0c4-9674ed5a5219 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:22.423337 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ca5b0e6-a242-46da-b0c4-9674ed5a5219 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:22.424076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ca5b0e6-a242-46da-b0c4-9674ed5a5219 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:22.424690 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ca5b0e6-a242-46da-b0c4-9674ed5a5219 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:22.425705 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ca5b0e6-a242-46da-b0c4-9674ed5a5219 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:22.426314 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ca5b0e6-a242-46da-b0c4-9674ed5a5219 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:22.426889 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ca5b0e6-a242-46da-b0c4-9674ed5a5219 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:22.596312 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9e75d24a-83e2-4aa3-a37a-141207fd55ab tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:22.597543 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9e75d24a-83e2-4aa3-a37a-141207fd55ab tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:22.605160 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e75d24a-83e2-4aa3-a37a-141207fd55ab tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:22.605911 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e75d24a-83e2-4aa3-a37a-141207fd55ab tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:22.606342 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e75d24a-83e2-4aa3-a37a-141207fd55ab tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:22.608283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e75d24a-83e2-4aa3-a37a-141207fd55ab tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:22.608535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e75d24a-83e2-4aa3-a37a-141207fd55ab tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:22.608984 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e75d24a-83e2-4aa3-a37a-141207fd55ab tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:22.678706 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5ca5b0e6-a242-46da-b0c4-9674ed5a5219 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:22.688105 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5ca5b0e6-a242-46da-b0c4-9674ed5a5219 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.280823 Aug 05 02:21:22.689042 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 93/185] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:22 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:22.755707 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-86ab568b-b137-459d-a449-45a1113673fd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:22.757219 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-86ab568b-b137-459d-a449-45a1113673fd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:22.763511 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86ab568b-b137-459d-a449-45a1113673fd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:22.764317 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86ab568b-b137-459d-a449-45a1113673fd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:22.765019 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86ab568b-b137-459d-a449-45a1113673fd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:22.765953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86ab568b-b137-459d-a449-45a1113673fd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:22.766609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86ab568b-b137-459d-a449-45a1113673fd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:22.767234 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86ab568b-b137-459d-a449-45a1113673fd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:22.775037 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9e75d24a-83e2-4aa3-a37a-141207fd55ab tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:22.782954 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9e75d24a-83e2-4aa3-a37a-141207fd55ab tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.191808 Aug 05 02:21:22.784946 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 93/186] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:22 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:22.993800 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-86ab568b-b137-459d-a449-45a1113673fd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:23.002673 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-576f3832-8ea9-431a-b5f9-b6ac91b94973 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:23.003482 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-86ab568b-b137-459d-a449-45a1113673fd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:23.003851 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-576f3832-8ea9-431a-b5f9-b6ac91b94973 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:23.005539 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-86ab568b-b137-459d-a449-45a1113673fd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:23.006744 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-86ab568b-b137-459d-a449-45a1113673fd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.254947 Aug 05 02:21:23.007828 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 94/187] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:22 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:21:23.018422 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-576f3832-8ea9-431a-b5f9-b6ac91b94973 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:23.019243 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-576f3832-8ea9-431a-b5f9-b6ac91b94973 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:23.020419 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-576f3832-8ea9-431a-b5f9-b6ac91b94973 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:23.022081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-576f3832-8ea9-431a-b5f9-b6ac91b94973 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:23.022695 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-576f3832-8ea9-431a-b5f9-b6ac91b94973 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:23.023194 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-576f3832-8ea9-431a-b5f9-b6ac91b94973 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:23.053911 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e6c1c2f8-30ec-4f6a-8bc6-dafe78ec1cf1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:23.054554 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e6c1c2f8-30ec-4f6a-8bc6-dafe78ec1cf1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:23.063253 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e6c1c2f8-30ec-4f6a-8bc6-dafe78ec1cf1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:23.063739 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e6c1c2f8-30ec-4f6a-8bc6-dafe78ec1cf1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:23.064169 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e6c1c2f8-30ec-4f6a-8bc6-dafe78ec1cf1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:23.064992 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e6c1c2f8-30ec-4f6a-8bc6-dafe78ec1cf1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:23.065339 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e6c1c2f8-30ec-4f6a-8bc6-dafe78ec1cf1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:23.066009 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e6c1c2f8-30ec-4f6a-8bc6-dafe78ec1cf1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:23.238667 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-576f3832-8ea9-431a-b5f9-b6ac91b94973 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:23.251464 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-576f3832-8ea9-431a-b5f9-b6ac91b94973 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.256153 Aug 05 02:21:23.252826 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 94/188] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:22 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:23.393400 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e6c1c2f8-30ec-4f6a-8bc6-dafe78ec1cf1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:23.408024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e6c1c2f8-30ec-4f6a-8bc6-dafe78ec1cf1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.363983 Aug 05 02:21:23.408839 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 95/189] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:23 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:23.711101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6e8f24c7-6d21-4a39-948a-992e7b6b65ef tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:23.711726 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6e8f24c7-6d21-4a39-948a-992e7b6b65ef tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:23.718518 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e8f24c7-6d21-4a39-948a-992e7b6b65ef tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:23.719011 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e8f24c7-6d21-4a39-948a-992e7b6b65ef tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:23.719451 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e8f24c7-6d21-4a39-948a-992e7b6b65ef tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:23.720209 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e8f24c7-6d21-4a39-948a-992e7b6b65ef tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:23.721236 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e8f24c7-6d21-4a39-948a-992e7b6b65ef tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:23.721663 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e8f24c7-6d21-4a39-948a-992e7b6b65ef tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:23.806251 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-69387199-1cff-4f29-8b1c-50dd5cac9eaf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:23.813154 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-69387199-1cff-4f29-8b1c-50dd5cac9eaf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:23.819739 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-69387199-1cff-4f29-8b1c-50dd5cac9eaf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:23.820543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-69387199-1cff-4f29-8b1c-50dd5cac9eaf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:23.821207 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-69387199-1cff-4f29-8b1c-50dd5cac9eaf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:23.822168 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-69387199-1cff-4f29-8b1c-50dd5cac9eaf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:23.822830 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-69387199-1cff-4f29-8b1c-50dd5cac9eaf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:23.823716 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-69387199-1cff-4f29-8b1c-50dd5cac9eaf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:23.879719 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6e8f24c7-6d21-4a39-948a-992e7b6b65ef tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:23.890804 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6e8f24c7-6d21-4a39-948a-992e7b6b65ef tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.185489 Aug 05 02:21:23.891501 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 95/190] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:23 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:24.030763 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0b93e2c1-b8c5-48e6-b7fe-2c6d8f644ed5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:24.031728 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0b93e2c1-b8c5-48e6-b7fe-2c6d8f644ed5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:24.040759 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b93e2c1-b8c5-48e6-b7fe-2c6d8f644ed5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:24.041462 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b93e2c1-b8c5-48e6-b7fe-2c6d8f644ed5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:24.042097 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b93e2c1-b8c5-48e6-b7fe-2c6d8f644ed5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:24.042919 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b93e2c1-b8c5-48e6-b7fe-2c6d8f644ed5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:24.043434 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b93e2c1-b8c5-48e6-b7fe-2c6d8f644ed5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:24.044825 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b93e2c1-b8c5-48e6-b7fe-2c6d8f644ed5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:24.202028 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0b93e2c1-b8c5-48e6-b7fe-2c6d8f644ed5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:24.211315 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0b93e2c1-b8c5-48e6-b7fe-2c6d8f644ed5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:24.213164 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0b93e2c1-b8c5-48e6-b7fe-2c6d8f644ed5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:24.214638 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0b93e2c1-b8c5-48e6-b7fe-2c6d8f644ed5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.188556 Aug 05 02:21:24.217057 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 96/191] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:24 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:24.253529 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-69387199-1cff-4f29-8b1c-50dd5cac9eaf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:24.268360 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-69387199-1cff-4f29-8b1c-50dd5cac9eaf tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.465909 Aug 05 02:21:24.269686 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 96/192] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:23 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:24.275756 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-01e450c1-07dc-4bb1-b297-3a8ab6f23181 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:24.276524 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-01e450c1-07dc-4bb1-b297-3a8ab6f23181 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:24.284825 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01e450c1-07dc-4bb1-b297-3a8ab6f23181 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:24.285586 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01e450c1-07dc-4bb1-b297-3a8ab6f23181 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:24.286616 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01e450c1-07dc-4bb1-b297-3a8ab6f23181 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:24.287730 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01e450c1-07dc-4bb1-b297-3a8ab6f23181 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:24.288411 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01e450c1-07dc-4bb1-b297-3a8ab6f23181 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:24.289706 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01e450c1-07dc-4bb1-b297-3a8ab6f23181 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:24.432853 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0ab7e30a-4031-49ee-9991-88bc7a3604c6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:24.433901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0ab7e30a-4031-49ee-9991-88bc7a3604c6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:24.443522 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab7e30a-4031-49ee-9991-88bc7a3604c6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:24.444540 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab7e30a-4031-49ee-9991-88bc7a3604c6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:24.445592 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab7e30a-4031-49ee-9991-88bc7a3604c6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:24.446813 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab7e30a-4031-49ee-9991-88bc7a3604c6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:24.447467 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab7e30a-4031-49ee-9991-88bc7a3604c6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:24.448056 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0ab7e30a-4031-49ee-9991-88bc7a3604c6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:24.524975 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-01e450c1-07dc-4bb1-b297-3a8ab6f23181 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:24.533147 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-01e450c1-07dc-4bb1-b297-3a8ab6f23181 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.264182 Aug 05 02:21:24.546184 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 97/193] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:24 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:24.796656 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0ab7e30a-4031-49ee-9991-88bc7a3604c6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:24.805089 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0ab7e30a-4031-49ee-9991-88bc7a3604c6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.379241 Aug 05 02:21:24.805900 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 97/194] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:24 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:24.911823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8aa7d4c4-f366-4e00-9e59-90fb02f1911b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:24.912463 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8aa7d4c4-f366-4e00-9e59-90fb02f1911b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:24.919029 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8aa7d4c4-f366-4e00-9e59-90fb02f1911b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:24.919888 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8aa7d4c4-f366-4e00-9e59-90fb02f1911b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:24.920786 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8aa7d4c4-f366-4e00-9e59-90fb02f1911b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:24.921644 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8aa7d4c4-f366-4e00-9e59-90fb02f1911b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:24.922235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8aa7d4c4-f366-4e00-9e59-90fb02f1911b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:24.922997 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8aa7d4c4-f366-4e00-9e59-90fb02f1911b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:25.148059 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8aa7d4c4-f366-4e00-9e59-90fb02f1911b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:25.165748 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8aa7d4c4-f366-4e00-9e59-90fb02f1911b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.255840 Aug 05 02:21:25.166476 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 98/195] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:24 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:25.239547 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bcf0ef02-ad4d-4295-86a9-030689854942 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:25.240386 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bcf0ef02-ad4d-4295-86a9-030689854942 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:25.246793 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcf0ef02-ad4d-4295-86a9-030689854942 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:25.248233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcf0ef02-ad4d-4295-86a9-030689854942 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:25.248936 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcf0ef02-ad4d-4295-86a9-030689854942 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:25.249888 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcf0ef02-ad4d-4295-86a9-030689854942 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:25.250436 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcf0ef02-ad4d-4295-86a9-030689854942 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:25.251006 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcf0ef02-ad4d-4295-86a9-030689854942 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:25.289549 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-79051e9c-e5a2-48be-b079-0cb6993cc621 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:25.290157 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-79051e9c-e5a2-48be-b079-0cb6993cc621 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:25.296722 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-79051e9c-e5a2-48be-b079-0cb6993cc621 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:25.297124 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-79051e9c-e5a2-48be-b079-0cb6993cc621 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:25.297555 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-79051e9c-e5a2-48be-b079-0cb6993cc621 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:25.298241 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-79051e9c-e5a2-48be-b079-0cb6993cc621 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:25.298684 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-79051e9c-e5a2-48be-b079-0cb6993cc621 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:25.299359 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-79051e9c-e5a2-48be-b079-0cb6993cc621 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:25.445892 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-79051e9c-e5a2-48be-b079-0cb6993cc621 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:25.457944 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-79051e9c-e5a2-48be-b079-0cb6993cc621 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.172164 Aug 05 02:21:25.473564 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 99/196] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:25 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:25.536813 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bcf0ef02-ad4d-4295-86a9-030689854942 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:25.552165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bcf0ef02-ad4d-4295-86a9-030689854942 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:25.554231 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bcf0ef02-ad4d-4295-86a9-030689854942 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:25.555771 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bcf0ef02-ad4d-4295-86a9-030689854942 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.319989 Aug 05 02:21:25.556141 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0fe1022b-4df1-4ddc-b057-d74403f445bd tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:25.556942 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0fe1022b-4df1-4ddc-b057-d74403f445bd tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:25.558444 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 98/197] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:25 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:25.571298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fe1022b-4df1-4ddc-b057-d74403f445bd tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:25.572188 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fe1022b-4df1-4ddc-b057-d74403f445bd tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:25.582688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fe1022b-4df1-4ddc-b057-d74403f445bd tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:25.584739 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fe1022b-4df1-4ddc-b057-d74403f445bd tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:25.585548 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fe1022b-4df1-4ddc-b057-d74403f445bd tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:25.600265 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fe1022b-4df1-4ddc-b057-d74403f445bd tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:25.815422 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0fe1022b-4df1-4ddc-b057-d74403f445bd tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:25.826260 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fcc94810-00be-423f-88c2-234685a59207 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:25.827416 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fcc94810-00be-423f-88c2-234685a59207 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:25.839564 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcc94810-00be-423f-88c2-234685a59207 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:25.840065 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcc94810-00be-423f-88c2-234685a59207 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:25.840536 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcc94810-00be-423f-88c2-234685a59207 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:25.843192 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0fe1022b-4df1-4ddc-b057-d74403f445bd tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.293628 Aug 05 02:21:25.843960 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 100/198] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:25 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:25.844858 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcc94810-00be-423f-88c2-234685a59207 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:25.848719 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcc94810-00be-423f-88c2-234685a59207 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:25.850611 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fcc94810-00be-423f-88c2-234685a59207 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:25.861004 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:26.082287 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fcc94810-00be-423f-88c2-234685a59207 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:26.101484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fcc94810-00be-423f-88c2-234685a59207 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.279313 Aug 05 02:21:26.103720 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 99/199] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:25 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:26.189161 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6536501c-8077-430a-b589-eb2181734183 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:26.190502 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6536501c-8077-430a-b589-eb2181734183 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:26.199291 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6536501c-8077-430a-b589-eb2181734183 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:26.200135 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6536501c-8077-430a-b589-eb2181734183 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:26.200959 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6536501c-8077-430a-b589-eb2181734183 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:26.202064 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6536501c-8077-430a-b589-eb2181734183 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:26.203576 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6536501c-8077-430a-b589-eb2181734183 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:26.204215 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6536501c-8077-430a-b589-eb2181734183 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:26.449069 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6536501c-8077-430a-b589-eb2181734183 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:26.457818 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6536501c-8077-430a-b589-eb2181734183 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.273659 Aug 05 02:21:26.458831 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 101/200] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:26 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:26.482364 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7bc868e1-3e01-4259-874f-b3077d8f99ec tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:26.484566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7bc868e1-3e01-4259-874f-b3077d8f99ec tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:26.494046 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7bc868e1-3e01-4259-874f-b3077d8f99ec tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:26.496183 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7bc868e1-3e01-4259-874f-b3077d8f99ec tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:26.497018 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7bc868e1-3e01-4259-874f-b3077d8f99ec tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:26.499360 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7bc868e1-3e01-4259-874f-b3077d8f99ec tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:26.500008 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7bc868e1-3e01-4259-874f-b3077d8f99ec tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:26.500662 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7bc868e1-3e01-4259-874f-b3077d8f99ec tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:26.583381 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-31bb9396-a622-444a-8732-d90d54aa0bd4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:26.584486 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-31bb9396-a622-444a-8732-d90d54aa0bd4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:26.592273 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-31bb9396-a622-444a-8732-d90d54aa0bd4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:26.592745 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-31bb9396-a622-444a-8732-d90d54aa0bd4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:26.593369 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-31bb9396-a622-444a-8732-d90d54aa0bd4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:26.594335 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-31bb9396-a622-444a-8732-d90d54aa0bd4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:26.595031 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-31bb9396-a622-444a-8732-d90d54aa0bd4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:26.596064 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-31bb9396-a622-444a-8732-d90d54aa0bd4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:26.625305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:26.756265 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-31bb9396-a622-444a-8732-d90d54aa0bd4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:26.765012 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-31bb9396-a622-444a-8732-d90d54aa0bd4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:26.766504 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-31bb9396-a622-444a-8732-d90d54aa0bd4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:26.767817 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-31bb9396-a622-444a-8732-d90d54aa0bd4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.188830 Aug 05 02:21:26.769013 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 102/201] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:26 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:26.811195 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7bc868e1-3e01-4259-874f-b3077d8f99ec tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:26.820427 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7bc868e1-3e01-4259-874f-b3077d8f99ec tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.342862 Aug 05 02:21:26.834753 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 100/202] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:26 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:26.870047 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-47e14468-89bb-4941-9e74-23ec3b6d1319 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:26.870687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-47e14468-89bb-4941-9e74-23ec3b6d1319 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:26.879149 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47e14468-89bb-4941-9e74-23ec3b6d1319 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:26.879630 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47e14468-89bb-4941-9e74-23ec3b6d1319 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:26.880059 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47e14468-89bb-4941-9e74-23ec3b6d1319 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:26.880801 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47e14468-89bb-4941-9e74-23ec3b6d1319 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:26.881247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47e14468-89bb-4941-9e74-23ec3b6d1319 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:26.881659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47e14468-89bb-4941-9e74-23ec3b6d1319 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:27.038101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-47e14468-89bb-4941-9e74-23ec3b6d1319 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:27.047374 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-47e14468-89bb-4941-9e74-23ec3b6d1319 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.184910 Aug 05 02:21:27.047374 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 103/203] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:26 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:27.127035 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-04488ac0-33fc-4a61-9df7-9b5fdb7767f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:27.127649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-04488ac0-33fc-4a61-9df7-9b5fdb7767f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:27.136282 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04488ac0-33fc-4a61-9df7-9b5fdb7767f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:27.136925 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04488ac0-33fc-4a61-9df7-9b5fdb7767f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:27.137423 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04488ac0-33fc-4a61-9df7-9b5fdb7767f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:27.138728 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04488ac0-33fc-4a61-9df7-9b5fdb7767f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:27.139241 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04488ac0-33fc-4a61-9df7-9b5fdb7767f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:27.139871 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04488ac0-33fc-4a61-9df7-9b5fdb7767f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:27.280540 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-04488ac0-33fc-4a61-9df7-9b5fdb7767f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:27.288827 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-04488ac0-33fc-4a61-9df7-9b5fdb7767f4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.169533 Aug 05 02:21:27.289805 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 101/204] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:27 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:27.479104 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-786e1b6f-68c8-4018-8f52-f4afb03b2acd tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:27.479703 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-786e1b6f-68c8-4018-8f52-f4afb03b2acd tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:27.486599 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-786e1b6f-68c8-4018-8f52-f4afb03b2acd tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:27.487103 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-786e1b6f-68c8-4018-8f52-f4afb03b2acd tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:27.487538 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-786e1b6f-68c8-4018-8f52-f4afb03b2acd tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:27.488225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-786e1b6f-68c8-4018-8f52-f4afb03b2acd tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:27.488877 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-786e1b6f-68c8-4018-8f52-f4afb03b2acd tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:27.489543 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-786e1b6f-68c8-4018-8f52-f4afb03b2acd tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:27.689101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-786e1b6f-68c8-4018-8f52-f4afb03b2acd tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:27.698122 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-786e1b6f-68c8-4018-8f52-f4afb03b2acd tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.222823 Aug 05 02:21:27.698920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 104/205] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:27 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:27.791442 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-96c45c4e-0bd0-4de4-ad2c-3b1b7662a4ec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:27.792693 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-96c45c4e-0bd0-4de4-ad2c-3b1b7662a4ec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:27.799986 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96c45c4e-0bd0-4de4-ad2c-3b1b7662a4ec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:27.800938 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96c45c4e-0bd0-4de4-ad2c-3b1b7662a4ec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:27.801542 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96c45c4e-0bd0-4de4-ad2c-3b1b7662a4ec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:27.802581 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96c45c4e-0bd0-4de4-ad2c-3b1b7662a4ec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:27.803453 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96c45c4e-0bd0-4de4-ad2c-3b1b7662a4ec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:27.804024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96c45c4e-0bd0-4de4-ad2c-3b1b7662a4ec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:27.845056 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-19d412a1-f167-4859-ba2c-7195b70961d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:27.846375 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-19d412a1-f167-4859-ba2c-7195b70961d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:27.855989 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19d412a1-f167-4859-ba2c-7195b70961d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:27.858662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19d412a1-f167-4859-ba2c-7195b70961d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:27.859342 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19d412a1-f167-4859-ba2c-7195b70961d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:27.860370 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19d412a1-f167-4859-ba2c-7195b70961d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:27.861031 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19d412a1-f167-4859-ba2c-7195b70961d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:27.861675 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19d412a1-f167-4859-ba2c-7195b70961d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:28.025079 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96c45c4e-0bd0-4de4-ad2c-3b1b7662a4ec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:28.034727 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96c45c4e-0bd0-4de4-ad2c-3b1b7662a4ec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:28.036379 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96c45c4e-0bd0-4de4-ad2c-3b1b7662a4ec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:28.037504 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-96c45c4e-0bd0-4de4-ad2c-3b1b7662a4ec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.249872 Aug 05 02:21:28.038052 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 102/206] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:27 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:21:28.069076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f0d4da13-eb8b-425a-98e1-69dff203a31b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:28.070007 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f0d4da13-eb8b-425a-98e1-69dff203a31b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:28.082262 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0d4da13-eb8b-425a-98e1-69dff203a31b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:28.083811 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0d4da13-eb8b-425a-98e1-69dff203a31b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:28.084620 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0d4da13-eb8b-425a-98e1-69dff203a31b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:28.085778 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0d4da13-eb8b-425a-98e1-69dff203a31b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:28.086466 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0d4da13-eb8b-425a-98e1-69dff203a31b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:28.087163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0d4da13-eb8b-425a-98e1-69dff203a31b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:28.147463 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-19d412a1-f167-4859-ba2c-7195b70961d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:28.158825 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-19d412a1-f167-4859-ba2c-7195b70961d1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.318575 Aug 05 02:21:28.159398 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 105/207] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:27 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:28.269983 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f0d4da13-eb8b-425a-98e1-69dff203a31b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:28.281216 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f0d4da13-eb8b-425a-98e1-69dff203a31b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.216765 Aug 05 02:21:28.281996 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 103/208] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:28 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:28.311817 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4878f808-83aa-4667-9a32-c04bd633ace4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:28.312517 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4878f808-83aa-4667-9a32-c04bd633ace4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:28.319348 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4878f808-83aa-4667-9a32-c04bd633ace4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:28.319883 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4878f808-83aa-4667-9a32-c04bd633ace4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:28.320381 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4878f808-83aa-4667-9a32-c04bd633ace4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:28.321361 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4878f808-83aa-4667-9a32-c04bd633ace4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:28.321979 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4878f808-83aa-4667-9a32-c04bd633ace4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:28.322453 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4878f808-83aa-4667-9a32-c04bd633ace4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:28.521977 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4878f808-83aa-4667-9a32-c04bd633ace4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:28.534283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4878f808-83aa-4667-9a32-c04bd633ace4 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.227402 Aug 05 02:21:28.537462 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 106/209] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:28 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:28.720571 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4b2c79f1-76fa-44a1-85c3-b0257070697f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:28.721489 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4b2c79f1-76fa-44a1-85c3-b0257070697f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:28.733862 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b2c79f1-76fa-44a1-85c3-b0257070697f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:28.734354 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b2c79f1-76fa-44a1-85c3-b0257070697f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:28.734782 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b2c79f1-76fa-44a1-85c3-b0257070697f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:28.735485 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b2c79f1-76fa-44a1-85c3-b0257070697f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:28.735932 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b2c79f1-76fa-44a1-85c3-b0257070697f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:28.736376 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b2c79f1-76fa-44a1-85c3-b0257070697f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:28.946742 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b2c79f1-76fa-44a1-85c3-b0257070697f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:28.973251 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4b2c79f1-76fa-44a1-85c3-b0257070697f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.252893 Aug 05 02:21:28.973988 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 104/210] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:28 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:28.992762 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-c7334b65-cb67-4b45-827a-f2e9bec6d913 req-ddae86f6-87a9-4f64-9b0f-9747a5bc8423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319a8a64-7b50-4fff-93b6-4498b53265ab", "name": "network-vif-plugged", "status": "completed", "tag": "661635b8-8836-4704-91ee-343c5d3a40eb"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:21:29.003194 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-c7334b65-cb67-4b45-827a-f2e9bec6d913 req-ddae86f6-87a9-4f64-9b0f-9747a5bc8423 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:29.004107 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-c7334b65-cb67-4b45-827a-f2e9bec6d913 req-ddae86f6-87a9-4f64-9b0f-9747a5bc8423 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:29.004707 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-c7334b65-cb67-4b45-827a-f2e9bec6d913 req-ddae86f6-87a9-4f64-9b0f-9747a5bc8423 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:29.018694 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-c7334b65-cb67-4b45-827a-f2e9bec6d913 req-ddae86f6-87a9-4f64-9b0f-9747a5bc8423 service nova] Creating event network-vif-plugged:661635b8-8836-4704-91ee-343c5d3a40eb for instance 319a8a64-7b50-4fff-93b6-4498b53265ab on hv-cinder-81558 Aug 05 02:21:29.024453 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-c7334b65-cb67-4b45-827a-f2e9bec6d913 req-ddae86f6-87a9-4f64-9b0f-9747a5bc8423 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035179 Aug 05 02:21:29.025349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 107/211] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:21:29.066994 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ed3df4a4-5369-44f7-8bce-10612b5055d9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:29.067890 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ed3df4a4-5369-44f7-8bce-10612b5055d9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:29.076816 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed3df4a4-5369-44f7-8bce-10612b5055d9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:29.077536 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed3df4a4-5369-44f7-8bce-10612b5055d9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:29.078142 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed3df4a4-5369-44f7-8bce-10612b5055d9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:29.079156 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed3df4a4-5369-44f7-8bce-10612b5055d9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:29.079821 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed3df4a4-5369-44f7-8bce-10612b5055d9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:29.081844 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed3df4a4-5369-44f7-8bce-10612b5055d9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:29.182220 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-faebcd11-40f4-4f0a-9b41-6602933e0436 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:29.183148 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-faebcd11-40f4-4f0a-9b41-6602933e0436 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:29.192944 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-faebcd11-40f4-4f0a-9b41-6602933e0436 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:29.200679 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-faebcd11-40f4-4f0a-9b41-6602933e0436 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:29.201671 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-faebcd11-40f4-4f0a-9b41-6602933e0436 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:29.202594 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-faebcd11-40f4-4f0a-9b41-6602933e0436 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:29.203206 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-faebcd11-40f4-4f0a-9b41-6602933e0436 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:29.203973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-faebcd11-40f4-4f0a-9b41-6602933e0436 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:29.956590 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-faebcd11-40f4-4f0a-9b41-6602933e0436 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:30.004914 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-faebcd11-40f4-4f0a-9b41-6602933e0436 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.801177 Aug 05 02:21:30.012395 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 108/212] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:29 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:30.040614 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-81db223d-3942-41ef-828d-ae0d31ab3921 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:30.041225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-81db223d-3942-41ef-828d-ae0d31ab3921 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:30.056428 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81db223d-3942-41ef-828d-ae0d31ab3921 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:30.056881 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81db223d-3942-41ef-828d-ae0d31ab3921 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:30.060059 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81db223d-3942-41ef-828d-ae0d31ab3921 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:30.064263 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81db223d-3942-41ef-828d-ae0d31ab3921 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:30.064799 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81db223d-3942-41ef-828d-ae0d31ab3921 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:30.078992 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-81db223d-3942-41ef-828d-ae0d31ab3921 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:30.209113 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ed3df4a4-5369-44f7-8bce-10612b5055d9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:30.225106 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ed3df4a4-5369-44f7-8bce-10612b5055d9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:30.226735 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ed3df4a4-5369-44f7-8bce-10612b5055d9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:30.228074 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ed3df4a4-5369-44f7-8bce-10612b5055d9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 1.168639 Aug 05 02:21:30.235903 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 105/213] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:29 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:30.251409 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-292b166b-3171-4fe5-8efe-60aa4dc8b37f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:30.252615 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-292b166b-3171-4fe5-8efe-60aa4dc8b37f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:30.271162 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-292b166b-3171-4fe5-8efe-60aa4dc8b37f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:30.271974 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-292b166b-3171-4fe5-8efe-60aa4dc8b37f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:30.274506 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-292b166b-3171-4fe5-8efe-60aa4dc8b37f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:30.277048 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-292b166b-3171-4fe5-8efe-60aa4dc8b37f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:30.277677 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-292b166b-3171-4fe5-8efe-60aa4dc8b37f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:30.280527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-292b166b-3171-4fe5-8efe-60aa4dc8b37f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:30.441243 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-81db223d-3942-41ef-828d-ae0d31ab3921 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:30.453310 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-81db223d-3942-41ef-828d-ae0d31ab3921 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1368 microversion: 2.1 time: 0.435186 Aug 05 02:21:30.454234 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 109/214] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:30 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1368 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:30.461247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7ca9f6e9-63ba-42e4-8948-88c0b28b363e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:30.467414 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7ca9f6e9-63ba-42e4-8948-88c0b28b363e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:30.474083 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ca9f6e9-63ba-42e4-8948-88c0b28b363e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:30.474867 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ca9f6e9-63ba-42e4-8948-88c0b28b363e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:30.475564 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ca9f6e9-63ba-42e4-8948-88c0b28b363e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:30.476537 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ca9f6e9-63ba-42e4-8948-88c0b28b363e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:30.477202 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ca9f6e9-63ba-42e4-8948-88c0b28b363e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:30.477931 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ca9f6e9-63ba-42e4-8948-88c0b28b363e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:30.483738 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-292b166b-3171-4fe5-8efe-60aa4dc8b37f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:30.493607 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-292b166b-3171-4fe5-8efe-60aa4dc8b37f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.255502 Aug 05 02:21:30.494866 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 106/215] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:30 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:30.887089 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7ca9f6e9-63ba-42e4-8948-88c0b28b363e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:30.899525 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7ca9f6e9-63ba-42e4-8948-88c0b28b363e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.443763 Aug 05 02:21:30.901804 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 110/216] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:30 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:31.031142 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bda8359f-9377-4606-ba60-011ad95bd29d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:31.033761 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bda8359f-9377-4606-ba60-011ad95bd29d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:31.041552 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bda8359f-9377-4606-ba60-011ad95bd29d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:31.042057 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bda8359f-9377-4606-ba60-011ad95bd29d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:31.042493 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bda8359f-9377-4606-ba60-011ad95bd29d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:31.043194 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bda8359f-9377-4606-ba60-011ad95bd29d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:31.043645 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bda8359f-9377-4606-ba60-011ad95bd29d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:31.045785 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bda8359f-9377-4606-ba60-011ad95bd29d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:31.213184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bda8359f-9377-4606-ba60-011ad95bd29d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:31.222701 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bda8359f-9377-4606-ba60-011ad95bd29d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.197185 Aug 05 02:21:31.224125 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 107/217] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:31 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:31.236078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-4e754ec2-1c41-4485-8787-120dbe20e256 req-05e5ce17-7895-4cb8-85e0-a467c793c3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3", "name": "network-vif-plugged", "status": "completed", "tag": "9d9c2151-858a-4f4b-ae99-508b1aadb74a"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:21:31.260979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8a69188d-a6d6-4795-9a16-5206bf853564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:31.263539 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4e754ec2-1c41-4485-8787-120dbe20e256 req-05e5ce17-7895-4cb8-85e0-a467c793c3bf service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:31.264383 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8a69188d-a6d6-4795-9a16-5206bf853564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:31.267756 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4e754ec2-1c41-4485-8787-120dbe20e256 req-05e5ce17-7895-4cb8-85e0-a467c793c3bf service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:31.268635 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4e754ec2-1c41-4485-8787-120dbe20e256 req-05e5ce17-7895-4cb8-85e0-a467c793c3bf service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:31.280499 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a69188d-a6d6-4795-9a16-5206bf853564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:31.280943 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a69188d-a6d6-4795-9a16-5206bf853564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:31.281556 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a69188d-a6d6-4795-9a16-5206bf853564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:31.282596 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a69188d-a6d6-4795-9a16-5206bf853564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:31.283192 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a69188d-a6d6-4795-9a16-5206bf853564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:31.283822 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8a69188d-a6d6-4795-9a16-5206bf853564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:31.298873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-4e754ec2-1c41-4485-8787-120dbe20e256 req-05e5ce17-7895-4cb8-85e0-a467c793c3bf service nova] Creating event network-vif-plugged:9d9c2151-858a-4f4b-ae99-508b1aadb74a for instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 on hv-cinder-81558 Aug 05 02:21:31.306509 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-4e754ec2-1c41-4485-8787-120dbe20e256 req-05e5ce17-7895-4cb8-85e0-a467c793c3bf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075814 Aug 05 02:21:31.307509 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 111/218] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:21:31.475510 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a69188d-a6d6-4795-9a16-5206bf853564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:31.476183 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3710abb3-eec3-4bdc-ad95-e4825c1ebc16 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:31.477555 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3710abb3-eec3-4bdc-ad95-e4825c1ebc16 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:31.486934 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a69188d-a6d6-4795-9a16-5206bf853564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:31.487864 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3710abb3-eec3-4bdc-ad95-e4825c1ebc16 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:31.488385 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3710abb3-eec3-4bdc-ad95-e4825c1ebc16 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:31.494272 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3710abb3-eec3-4bdc-ad95-e4825c1ebc16 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:31.495069 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3710abb3-eec3-4bdc-ad95-e4825c1ebc16 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:31.496003 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8a69188d-a6d6-4795-9a16-5206bf853564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:31.496889 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3710abb3-eec3-4bdc-ad95-e4825c1ebc16 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:31.497597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8a69188d-a6d6-4795-9a16-5206bf853564 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.241836 Aug 05 02:21:31.498896 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 108/219] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:31 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:31.499440 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3710abb3-eec3-4bdc-ad95-e4825c1ebc16 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:31.519136 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-76ad07e6-4016-4682-a874-9bd6750eaba7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:31.520433 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-76ad07e6-4016-4682-a874-9bd6750eaba7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:31.529913 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76ad07e6-4016-4682-a874-9bd6750eaba7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:31.530690 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76ad07e6-4016-4682-a874-9bd6750eaba7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:31.531327 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76ad07e6-4016-4682-a874-9bd6750eaba7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:31.532232 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76ad07e6-4016-4682-a874-9bd6750eaba7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:31.533217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76ad07e6-4016-4682-a874-9bd6750eaba7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:31.533983 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76ad07e6-4016-4682-a874-9bd6750eaba7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:31.914914 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-76ad07e6-4016-4682-a874-9bd6750eaba7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:31.924152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-76ad07e6-4016-4682-a874-9bd6750eaba7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.413314 Aug 05 02:21:31.928866 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 109/220] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:31 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:31.943328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6e19d9fc-2eb8-4b68-b5cb-75922366b2bb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:31.944315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6e19d9fc-2eb8-4b68-b5cb-75922366b2bb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:31.953728 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3710abb3-eec3-4bdc-ad95-e4825c1ebc16 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:31.959650 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e19d9fc-2eb8-4b68-b5cb-75922366b2bb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:31.960550 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e19d9fc-2eb8-4b68-b5cb-75922366b2bb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:31.961258 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e19d9fc-2eb8-4b68-b5cb-75922366b2bb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:31.962594 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e19d9fc-2eb8-4b68-b5cb-75922366b2bb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:31.963557 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e19d9fc-2eb8-4b68-b5cb-75922366b2bb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:31.964252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6e19d9fc-2eb8-4b68-b5cb-75922366b2bb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:31.965710 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3710abb3-eec3-4bdc-ad95-e4825c1ebc16 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1558 microversion: 2.1 time: 0.493712 Aug 05 02:21:31.967302 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 112/221] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:31 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1558 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:31.997560 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-85464ecc-5745-4bd7-b1a1-642967280324 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:31.998046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-85464ecc-5745-4bd7-b1a1-642967280324 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:32.013454 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-85464ecc-5745-4bd7-b1a1-642967280324 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:32.014324 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-85464ecc-5745-4bd7-b1a1-642967280324 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:32.014962 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-85464ecc-5745-4bd7-b1a1-642967280324 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:32.016071 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-85464ecc-5745-4bd7-b1a1-642967280324 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:32.017341 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-85464ecc-5745-4bd7-b1a1-642967280324 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:32.033204 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-85464ecc-5745-4bd7-b1a1-642967280324 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:32.251995 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6e19d9fc-2eb8-4b68-b5cb-75922366b2bb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:32.266599 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6e19d9fc-2eb8-4b68-b5cb-75922366b2bb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.333061 Aug 05 02:21:32.267191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 110/222] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:31 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:32.283331 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-46360ae1-ceff-4e4f-a203-26c850f9645c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:32.284063 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-46360ae1-ceff-4e4f-a203-26c850f9645c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:32.301068 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46360ae1-ceff-4e4f-a203-26c850f9645c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:32.304496 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46360ae1-ceff-4e4f-a203-26c850f9645c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:32.305074 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46360ae1-ceff-4e4f-a203-26c850f9645c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:32.305967 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46360ae1-ceff-4e4f-a203-26c850f9645c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:32.306503 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46360ae1-ceff-4e4f-a203-26c850f9645c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:32.307008 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46360ae1-ceff-4e4f-a203-26c850f9645c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:32.307348 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-85464ecc-5745-4bd7-b1a1-642967280324 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.319896 Aug 05 02:21:32.309043 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 113/223] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Aug 5 02:21:31 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70/os-interface => generated 285 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:21:32.521922 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-41f392a1-b590-4a7c-9fa5-9667bae0e0d0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:32.522538 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-41f392a1-b590-4a7c-9fa5-9667bae0e0d0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:32.536469 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-41f392a1-b590-4a7c-9fa5-9667bae0e0d0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:32.539153 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-41f392a1-b590-4a7c-9fa5-9667bae0e0d0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:32.541157 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-41f392a1-b590-4a7c-9fa5-9667bae0e0d0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:32.549542 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-41f392a1-b590-4a7c-9fa5-9667bae0e0d0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:32.550216 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-41f392a1-b590-4a7c-9fa5-9667bae0e0d0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:32.550813 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-41f392a1-b590-4a7c-9fa5-9667bae0e0d0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:33.345280 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-46360ae1-ceff-4e4f-a203-26c850f9645c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:33.363567 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-46360ae1-ceff-4e4f-a203-26c850f9645c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 1.094036 Aug 05 02:21:33.366773 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 111/224] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:32 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:33.380153 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eaa53f14-0415-4f62-bdf1-f07d10fd9d37 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:33.380153 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eaa53f14-0415-4f62-bdf1-f07d10fd9d37 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:33.405796 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eaa53f14-0415-4f62-bdf1-f07d10fd9d37 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:33.406403 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eaa53f14-0415-4f62-bdf1-f07d10fd9d37 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:33.406916 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eaa53f14-0415-4f62-bdf1-f07d10fd9d37 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:33.407725 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eaa53f14-0415-4f62-bdf1-f07d10fd9d37 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:33.409175 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eaa53f14-0415-4f62-bdf1-f07d10fd9d37 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:33.412366 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eaa53f14-0415-4f62-bdf1-f07d10fd9d37 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:34.024359 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-41f392a1-b590-4a7c-9fa5-9667bae0e0d0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:34.037705 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-41f392a1-b590-4a7c-9fa5-9667bae0e0d0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:34.038922 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-41f392a1-b590-4a7c-9fa5-9667bae0e0d0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:34.040035 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-41f392a1-b590-4a7c-9fa5-9667bae0e0d0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 1.522389 Aug 05 02:21:34.042022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 114/225] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:32 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:34.069784 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-793df6b7-6c1f-4ebb-9b05-29fd615c1d7c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:34.070594 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-793df6b7-6c1f-4ebb-9b05-29fd615c1d7c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:34.077850 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-793df6b7-6c1f-4ebb-9b05-29fd615c1d7c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:34.078685 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-793df6b7-6c1f-4ebb-9b05-29fd615c1d7c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:34.079262 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-793df6b7-6c1f-4ebb-9b05-29fd615c1d7c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:34.080119 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-793df6b7-6c1f-4ebb-9b05-29fd615c1d7c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:34.080745 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-793df6b7-6c1f-4ebb-9b05-29fd615c1d7c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:34.081318 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-793df6b7-6c1f-4ebb-9b05-29fd615c1d7c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:34.344452 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eaa53f14-0415-4f62-bdf1-f07d10fd9d37 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:34.354210 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eaa53f14-0415-4f62-bdf1-f07d10fd9d37 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.982611 Aug 05 02:21:34.358085 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 112/226] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:33 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:34.361984 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-793df6b7-6c1f-4ebb-9b05-29fd615c1d7c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:34.365682 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-0bbda684-6e3d-469b-bcf5-33b247efcdb0 req-4f131011-59ee-40c9-83cc-6e5739c6f1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d325dc2e-780c-41fe-bdad-ac41805f3534", "name": "network-vif-plugged", "status": "completed", "tag": "c3c4ea12-20f0-402c-a002-d09aebd27024"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:21:34.378824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-793df6b7-6c1f-4ebb-9b05-29fd615c1d7c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.320373 Aug 05 02:21:34.379791 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 115/227] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:34 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:34.387190 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e3aefbff-d3fb-41b7-a6aa-88deaaff9718 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:34.389441 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0bbda684-6e3d-469b-bcf5-33b247efcdb0 req-4f131011-59ee-40c9-83cc-6e5739c6f1eb service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:34.391507 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0bbda684-6e3d-469b-bcf5-33b247efcdb0 req-4f131011-59ee-40c9-83cc-6e5739c6f1eb service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:34.392227 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e3aefbff-d3fb-41b7-a6aa-88deaaff9718 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:34.392925 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0bbda684-6e3d-469b-bcf5-33b247efcdb0 req-4f131011-59ee-40c9-83cc-6e5739c6f1eb service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:34.409592 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3aefbff-d3fb-41b7-a6aa-88deaaff9718 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:34.411361 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3aefbff-d3fb-41b7-a6aa-88deaaff9718 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:34.411842 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3aefbff-d3fb-41b7-a6aa-88deaaff9718 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:34.413518 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-0bbda684-6e3d-469b-bcf5-33b247efcdb0 req-4f131011-59ee-40c9-83cc-6e5739c6f1eb service nova] Creating event network-vif-plugged:c3c4ea12-20f0-402c-a002-d09aebd27024 for instance d325dc2e-780c-41fe-bdad-ac41805f3534 on hv-cinder-81558 Aug 05 02:21:34.414946 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3aefbff-d3fb-41b7-a6aa-88deaaff9718 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:34.415443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3aefbff-d3fb-41b7-a6aa-88deaaff9718 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:34.415877 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e3aefbff-d3fb-41b7-a6aa-88deaaff9718 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:34.421220 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-0bbda684-6e3d-469b-bcf5-33b247efcdb0 req-4f131011-59ee-40c9-83cc-6e5739c6f1eb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061690 Aug 05 02:21:34.422360 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 113/228] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:21:34.821637 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e3aefbff-d3fb-41b7-a6aa-88deaaff9718 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:34.831258 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e3aefbff-d3fb-41b7-a6aa-88deaaff9718 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.447677 Aug 05 02:21:34.845395 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 116/229] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:34 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:35.071469 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-28925468-bf51-4c79-8457-1d49fc2750e0 req-358ebaac-c857-424d-9a74-94c06f5d6bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a387642-9e46-4a64-8017-43786f426b70", "tag": "7885d180-df69-43cf-b111-f789955314dc"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:21:35.072972 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-84c6f5c0-44a9-4a8f-a677-f6138132948b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:35.073726 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-84c6f5c0-44a9-4a8f-a677-f6138132948b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:35.096020 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84c6f5c0-44a9-4a8f-a677-f6138132948b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:35.096560 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84c6f5c0-44a9-4a8f-a677-f6138132948b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:35.096999 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84c6f5c0-44a9-4a8f-a677-f6138132948b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:35.101149 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84c6f5c0-44a9-4a8f-a677-f6138132948b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:35.101857 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-28925468-bf51-4c79-8457-1d49fc2750e0 req-358ebaac-c857-424d-9a74-94c06f5d6bc6 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:35.102501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84c6f5c0-44a9-4a8f-a677-f6138132948b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:35.103239 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-28925468-bf51-4c79-8457-1d49fc2750e0 req-358ebaac-c857-424d-9a74-94c06f5d6bc6 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:35.103837 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84c6f5c0-44a9-4a8f-a677-f6138132948b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:35.104446 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-28925468-bf51-4c79-8457-1d49fc2750e0 req-358ebaac-c857-424d-9a74-94c06f5d6bc6 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:35.141038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-28925468-bf51-4c79-8457-1d49fc2750e0 req-358ebaac-c857-424d-9a74-94c06f5d6bc6 service nova] Creating event network-changed:7885d180-df69-43cf-b111-f789955314dc for instance 1a387642-9e46-4a64-8017-43786f426b70 on hv-cinder-81558 Aug 05 02:21:35.158861 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-28925468-bf51-4c79-8457-1d49fc2750e0 req-358ebaac-c857-424d-9a74-94c06f5d6bc6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090766 Aug 05 02:21:35.159760 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 117/230] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:21:35.380548 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-79694c7c-7c3e-4d2d-ab0e-0569e8d64035 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:35.381400 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-79694c7c-7c3e-4d2d-ab0e-0569e8d64035 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:35.391472 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-79694c7c-7c3e-4d2d-ab0e-0569e8d64035 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:35.391876 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-79694c7c-7c3e-4d2d-ab0e-0569e8d64035 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:35.392318 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-79694c7c-7c3e-4d2d-ab0e-0569e8d64035 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:35.401025 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-79694c7c-7c3e-4d2d-ab0e-0569e8d64035 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:35.401594 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-79694c7c-7c3e-4d2d-ab0e-0569e8d64035 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:35.402082 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-79694c7c-7c3e-4d2d-ab0e-0569e8d64035 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:35.421069 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-84c6f5c0-44a9-4a8f-a677-f6138132948b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:35.436545 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-84c6f5c0-44a9-4a8f-a677-f6138132948b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:35.444954 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-84c6f5c0-44a9-4a8f-a677-f6138132948b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:35.446222 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-84c6f5c0-44a9-4a8f-a677-f6138132948b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1406 microversion: 2.20 time: 0.380698 Aug 05 02:21:35.446775 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 114/231] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:35 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:35.468722 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1c46b481-12f9-436c-b9dc-b26889c3e1ea tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:35.469647 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1c46b481-12f9-436c-b9dc-b26889c3e1ea tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:35.479472 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c46b481-12f9-436c-b9dc-b26889c3e1ea tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:35.479935 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c46b481-12f9-436c-b9dc-b26889c3e1ea tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:35.480408 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c46b481-12f9-436c-b9dc-b26889c3e1ea tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:35.485224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c46b481-12f9-436c-b9dc-b26889c3e1ea tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:35.493112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c46b481-12f9-436c-b9dc-b26889c3e1ea tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:35.493818 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c46b481-12f9-436c-b9dc-b26889c3e1ea tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:35.794937 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1c46b481-12f9-436c-b9dc-b26889c3e1ea tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:35.807107 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1c46b481-12f9-436c-b9dc-b26889c3e1ea tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.355532 Aug 05 02:21:35.808209 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 115/232] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:35 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:35.830173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-79694c7c-7c3e-4d2d-ab0e-0569e8d64035 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:35.854929 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b03f0bea-498a-43af-842e-8ed6fed37615 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:35.855908 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b03f0bea-498a-43af-842e-8ed6fed37615 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:35.862940 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-79694c7c-7c3e-4d2d-ab0e-0569e8d64035 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.486768 Aug 05 02:21:35.868359 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 118/233] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:35 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:35.871575 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b03f0bea-498a-43af-842e-8ed6fed37615 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:35.872886 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b03f0bea-498a-43af-842e-8ed6fed37615 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:35.873740 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b03f0bea-498a-43af-842e-8ed6fed37615 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:35.874696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b03f0bea-498a-43af-842e-8ed6fed37615 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:35.875388 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b03f0bea-498a-43af-842e-8ed6fed37615 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:35.876035 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b03f0bea-498a-43af-842e-8ed6fed37615 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:35.908921 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:36.343592 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b03f0bea-498a-43af-842e-8ed6fed37615 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:36.354910 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b03f0bea-498a-43af-842e-8ed6fed37615 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.503463 Aug 05 02:21:36.356025 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 116/234] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:35 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:36.473493 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0da4035d-b254-46be-b219-ad75ac81574e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:36.474922 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0da4035d-b254-46be-b219-ad75ac81574e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:36.486372 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0da4035d-b254-46be-b219-ad75ac81574e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:36.487236 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0da4035d-b254-46be-b219-ad75ac81574e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:36.493080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0da4035d-b254-46be-b219-ad75ac81574e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:36.494380 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0da4035d-b254-46be-b219-ad75ac81574e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:36.495171 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0da4035d-b254-46be-b219-ad75ac81574e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:36.495981 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0da4035d-b254-46be-b219-ad75ac81574e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:36.833926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d30323a8-7e8d-4210-9a07-91424a8e363a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:36.834558 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d30323a8-7e8d-4210-9a07-91424a8e363a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:36.850352 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d30323a8-7e8d-4210-9a07-91424a8e363a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:36.851052 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d30323a8-7e8d-4210-9a07-91424a8e363a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:36.852130 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d30323a8-7e8d-4210-9a07-91424a8e363a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:36.853348 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d30323a8-7e8d-4210-9a07-91424a8e363a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:36.854161 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d30323a8-7e8d-4210-9a07-91424a8e363a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:36.855004 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d30323a8-7e8d-4210-9a07-91424a8e363a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:37.223457 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d30323a8-7e8d-4210-9a07-91424a8e363a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:37.242711 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d30323a8-7e8d-4210-9a07-91424a8e363a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.419489 Aug 05 02:21:37.244918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 117/235] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:36 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:37.274366 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b5db6305-d19b-4940-9076-d4cddb4a7e56 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:37.276904 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b5db6305-d19b-4940-9076-d4cddb4a7e56 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:37.291808 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5db6305-d19b-4940-9076-d4cddb4a7e56 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:37.293372 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5db6305-d19b-4940-9076-d4cddb4a7e56 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:37.296573 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5db6305-d19b-4940-9076-d4cddb4a7e56 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:37.298233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5db6305-d19b-4940-9076-d4cddb4a7e56 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:37.305749 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5db6305-d19b-4940-9076-d4cddb4a7e56 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:37.306355 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5db6305-d19b-4940-9076-d4cddb4a7e56 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:37.325430 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0da4035d-b254-46be-b219-ad75ac81574e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:37.345117 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0da4035d-b254-46be-b219-ad75ac81574e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:37.347372 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0da4035d-b254-46be-b219-ad75ac81574e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:37.349323 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0da4035d-b254-46be-b219-ad75ac81574e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1598 microversion: 2.20 time: 0.883033 Aug 05 02:21:37.350118 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 119/236] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:21:36 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1598 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:21:37.385722 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bd914acd-5f83-4c21-80d8-58a2e6705580 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:37.386465 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bd914acd-5f83-4c21-80d8-58a2e6705580 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:37.397621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd914acd-5f83-4c21-80d8-58a2e6705580 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:37.399828 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd914acd-5f83-4c21-80d8-58a2e6705580 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:37.400428 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd914acd-5f83-4c21-80d8-58a2e6705580 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:37.401429 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd914acd-5f83-4c21-80d8-58a2e6705580 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:37.404455 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd914acd-5f83-4c21-80d8-58a2e6705580 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:37.417005 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bd914acd-5f83-4c21-80d8-58a2e6705580 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:37.573607 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b5db6305-d19b-4940-9076-d4cddb4a7e56 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:37.586861 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b5db6305-d19b-4940-9076-d4cddb4a7e56 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.324137 Aug 05 02:21:37.596990 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 118/237] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:37 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:37.612299 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8386a3b2-057e-40ce-bf07-7212e47d0e87 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:37.613070 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8386a3b2-057e-40ce-bf07-7212e47d0e87 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:37.619896 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8386a3b2-057e-40ce-bf07-7212e47d0e87 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:37.620404 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8386a3b2-057e-40ce-bf07-7212e47d0e87 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:37.620837 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8386a3b2-057e-40ce-bf07-7212e47d0e87 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:37.621535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8386a3b2-057e-40ce-bf07-7212e47d0e87 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:37.622550 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8386a3b2-057e-40ce-bf07-7212e47d0e87 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:37.625836 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8386a3b2-057e-40ce-bf07-7212e47d0e87 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:37.719819 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bd914acd-5f83-4c21-80d8-58a2e6705580 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:37.735195 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bd914acd-5f83-4c21-80d8-58a2e6705580 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.357297 Aug 05 02:21:37.740580 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 120/238] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:37 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:37.892591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8386a3b2-057e-40ce-bf07-7212e47d0e87 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.294230 Aug 05 02:21:37.894279 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 119/239] 10.222.0.15 () {60 vars in 1316 bytes} [Fri Aug 5 02:21:37 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/os-interface => generated 285 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:21:38.269175 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a5c885b5-7338-415c-ae2e-5adabc892617 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:38.270943 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a5c885b5-7338-415c-ae2e-5adabc892617 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:38.284920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a5c885b5-7338-415c-ae2e-5adabc892617 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:38.290204 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a5c885b5-7338-415c-ae2e-5adabc892617 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:38.290737 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a5c885b5-7338-415c-ae2e-5adabc892617 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:38.291491 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a5c885b5-7338-415c-ae2e-5adabc892617 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:38.291952 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a5c885b5-7338-415c-ae2e-5adabc892617 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:38.292398 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a5c885b5-7338-415c-ae2e-5adabc892617 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:38.375897 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:38.618456 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5e8f268d-2bf6-4dd3-967e-386d0fa3feb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:38.619067 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5e8f268d-2bf6-4dd3-967e-386d0fa3feb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:38.637981 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e8f268d-2bf6-4dd3-967e-386d0fa3feb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:38.638733 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e8f268d-2bf6-4dd3-967e-386d0fa3feb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:38.640247 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e8f268d-2bf6-4dd3-967e-386d0fa3feb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:38.641142 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e8f268d-2bf6-4dd3-967e-386d0fa3feb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:38.644631 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e8f268d-2bf6-4dd3-967e-386d0fa3feb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:38.645079 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e8f268d-2bf6-4dd3-967e-386d0fa3feb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:38.677192 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a5c885b5-7338-415c-ae2e-5adabc892617 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:38.685801 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a5c885b5-7338-415c-ae2e-5adabc892617 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.420475 Aug 05 02:21:38.694270 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 121/240] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:38 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:38.764002 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fa136a8a-07f6-40de-b8de-ecc511b92720 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:38.765916 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fa136a8a-07f6-40de-b8de-ecc511b92720 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:38.772594 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa136a8a-07f6-40de-b8de-ecc511b92720 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:38.773379 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa136a8a-07f6-40de-b8de-ecc511b92720 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:38.774071 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa136a8a-07f6-40de-b8de-ecc511b92720 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:38.774972 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa136a8a-07f6-40de-b8de-ecc511b92720 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:38.775611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa136a8a-07f6-40de-b8de-ecc511b92720 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:38.776291 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fa136a8a-07f6-40de-b8de-ecc511b92720 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:38.958182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fa136a8a-07f6-40de-b8de-ecc511b92720 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:38.971167 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fa136a8a-07f6-40de-b8de-ecc511b92720 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.212122 Aug 05 02:21:38.972857 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 122/241] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:38 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:39.165477 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5e8f268d-2bf6-4dd3-967e-386d0fa3feb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:39.180569 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5e8f268d-2bf6-4dd3-967e-386d0fa3feb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1361 microversion: 2.1 time: 0.564508 Aug 05 02:21:39.187090 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 120/242] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:38 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1361 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:39.437777 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-8182edf3-bfd8-4874-bb0c-5d35f1a94b9d req-6d595106-b004-48db-82c8-edefd90fd5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2", "name": "network-vif-plugged", "status": "completed", "tag": "b8c923b8-6769-42f5-972e-79420f4f0498"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:21:39.454731 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:39.462832 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-8182edf3-bfd8-4874-bb0c-5d35f1a94b9d req-6d595106-b004-48db-82c8-edefd90fd5ec service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:39.463314 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-8182edf3-bfd8-4874-bb0c-5d35f1a94b9d req-6d595106-b004-48db-82c8-edefd90fd5ec service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:39.468426 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-8182edf3-bfd8-4874-bb0c-5d35f1a94b9d req-6d595106-b004-48db-82c8-edefd90fd5ec service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:39.502605 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-8182edf3-bfd8-4874-bb0c-5d35f1a94b9d req-6d595106-b004-48db-82c8-edefd90fd5ec service nova] Creating event network-vif-plugged:b8c923b8-6769-42f5-972e-79420f4f0498 for instance fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 on hv-cinder-81558 Aug 05 02:21:39.515747 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-8182edf3-bfd8-4874-bb0c-5d35f1a94b9d req-6d595106-b004-48db-82c8-edefd90fd5ec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082944 Aug 05 02:21:39.519024 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 123/243] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:21:39.708927 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9e7448b8-25e0-446e-992a-b5d08620b203 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:39.709782 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9e7448b8-25e0-446e-992a-b5d08620b203 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:39.730950 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e7448b8-25e0-446e-992a-b5d08620b203 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:39.732171 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e7448b8-25e0-446e-992a-b5d08620b203 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:39.740124 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e7448b8-25e0-446e-992a-b5d08620b203 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:39.741277 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e7448b8-25e0-446e-992a-b5d08620b203 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:39.744808 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e7448b8-25e0-446e-992a-b5d08620b203 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:39.745478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e7448b8-25e0-446e-992a-b5d08620b203 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:39.994755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5736ca96-57d2-4e5e-85c6-02cce06aefff tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:39.996160 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5736ca96-57d2-4e5e-85c6-02cce06aefff tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:40.025237 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5736ca96-57d2-4e5e-85c6-02cce06aefff tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:40.026932 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5736ca96-57d2-4e5e-85c6-02cce06aefff tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:40.030371 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5736ca96-57d2-4e5e-85c6-02cce06aefff tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:40.032849 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5736ca96-57d2-4e5e-85c6-02cce06aefff tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:40.035607 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5736ca96-57d2-4e5e-85c6-02cce06aefff tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:40.036343 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5736ca96-57d2-4e5e-85c6-02cce06aefff tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:40.297174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9e7448b8-25e0-446e-992a-b5d08620b203 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:40.312750 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9e7448b8-25e0-446e-992a-b5d08620b203 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1315 microversion: 2.1 time: 0.607903 Aug 05 02:21:40.314122 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 121/244] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:39 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:40.329743 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4c57110d-e9c6-477d-a41a-0b3ef12640e6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:40.330688 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4c57110d-e9c6-477d-a41a-0b3ef12640e6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:40.332637 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5736ca96-57d2-4e5e-85c6-02cce06aefff tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:40.340229 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5736ca96-57d2-4e5e-85c6-02cce06aefff tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.349747 Aug 05 02:21:40.354166 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c57110d-e9c6-477d-a41a-0b3ef12640e6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:40.355197 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c57110d-e9c6-477d-a41a-0b3ef12640e6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:40.358558 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 124/245] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:39 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:40.359532 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c57110d-e9c6-477d-a41a-0b3ef12640e6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:40.361620 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c57110d-e9c6-477d-a41a-0b3ef12640e6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:40.368814 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c57110d-e9c6-477d-a41a-0b3ef12640e6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:40.374115 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c57110d-e9c6-477d-a41a-0b3ef12640e6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:40.410701 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-ba154597-2352-4559-8cef-c70a65ba0205 req-09dfae69-d699-45ca-934f-0c7b2c6205d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319a8a64-7b50-4fff-93b6-4498b53265ab", "tag": "661635b8-8836-4704-91ee-343c5d3a40eb"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:21:40.451114 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-ba154597-2352-4559-8cef-c70a65ba0205 req-09dfae69-d699-45ca-934f-0c7b2c6205d1 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:40.454259 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-ba154597-2352-4559-8cef-c70a65ba0205 req-09dfae69-d699-45ca-934f-0c7b2c6205d1 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:40.454931 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-ba154597-2352-4559-8cef-c70a65ba0205 req-09dfae69-d699-45ca-934f-0c7b2c6205d1 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:40.482049 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-ba154597-2352-4559-8cef-c70a65ba0205 req-09dfae69-d699-45ca-934f-0c7b2c6205d1 service nova] Creating event network-changed:661635b8-8836-4704-91ee-343c5d3a40eb for instance 319a8a64-7b50-4fff-93b6-4498b53265ab on hv-cinder-81558 Aug 05 02:21:40.498226 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-ba154597-2352-4559-8cef-c70a65ba0205 req-09dfae69-d699-45ca-934f-0c7b2c6205d1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100758 Aug 05 02:21:40.501155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 125/246] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:21:40.613222 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4c57110d-e9c6-477d-a41a-0b3ef12640e6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:40.621260 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4c57110d-e9c6-477d-a41a-0b3ef12640e6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1547 microversion: 2.1 time: 0.305831 Aug 05 02:21:40.623246 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 122/247] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:40 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1547 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:40.645523 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-525bd8ee-48c8-48c3-9c33-9b63c7d7100e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:40.646350 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-525bd8ee-48c8-48c3-9c33-9b63c7d7100e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:40.652931 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-525bd8ee-48c8-48c3-9c33-9b63c7d7100e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:40.654347 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-525bd8ee-48c8-48c3-9c33-9b63c7d7100e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:40.655276 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-525bd8ee-48c8-48c3-9c33-9b63c7d7100e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:40.656247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-525bd8ee-48c8-48c3-9c33-9b63c7d7100e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:40.656889 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-525bd8ee-48c8-48c3-9c33-9b63c7d7100e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:40.657473 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-525bd8ee-48c8-48c3-9c33-9b63c7d7100e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:40.797954 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-525bd8ee-48c8-48c3-9c33-9b63c7d7100e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156519 Aug 05 02:21:40.799550 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 126/248] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Aug 5 02:21:40 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:21:41.339223 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6ab642f4-7972-4e2e-aa36-1081939c20b4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:41.342275 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6ab642f4-7972-4e2e-aa36-1081939c20b4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:41.351811 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ab642f4-7972-4e2e-aa36-1081939c20b4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:41.367125 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4ad1642c-659e-4b22-839b-0b79f740f311 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:41.371448 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4ad1642c-659e-4b22-839b-0b79f740f311 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:41.383634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ab642f4-7972-4e2e-aa36-1081939c20b4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:41.384866 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ab642f4-7972-4e2e-aa36-1081939c20b4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:41.386528 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ab642f4-7972-4e2e-aa36-1081939c20b4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:41.387022 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ab642f4-7972-4e2e-aa36-1081939c20b4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:41.387602 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ab642f4-7972-4e2e-aa36-1081939c20b4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:41.400276 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ad1642c-659e-4b22-839b-0b79f740f311 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:41.401108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ad1642c-659e-4b22-839b-0b79f740f311 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:41.401713 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ad1642c-659e-4b22-839b-0b79f740f311 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:41.402669 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ad1642c-659e-4b22-839b-0b79f740f311 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:41.403995 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ad1642c-659e-4b22-839b-0b79f740f311 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:41.404665 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ad1642c-659e-4b22-839b-0b79f740f311 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:41.797832 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6ab642f4-7972-4e2e-aa36-1081939c20b4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:41.820174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6ab642f4-7972-4e2e-aa36-1081939c20b4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1502 microversion: 2.1 time: 0.486092 Aug 05 02:21:41.820435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 123/249] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:41 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1502 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:42.105364 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4ad1642c-659e-4b22-839b-0b79f740f311 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:42.113620 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4ad1642c-659e-4b22-839b-0b79f740f311 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.753197 Aug 05 02:21:42.117134 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 127/250] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:41 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:42.966996 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-4261b942-36ac-41d3-8bef-b00239869d55 req-4f2b1e10-2aed-4973-8e00-71ad309b5894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d325dc2e-780c-41fe-bdad-ac41805f3534", "tag": "c3c4ea12-20f0-402c-a002-d09aebd27024"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:21:43.003468 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4261b942-36ac-41d3-8bef-b00239869d55 req-4f2b1e10-2aed-4973-8e00-71ad309b5894 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:43.003958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4261b942-36ac-41d3-8bef-b00239869d55 req-4f2b1e10-2aed-4973-8e00-71ad309b5894 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:43.006501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4261b942-36ac-41d3-8bef-b00239869d55 req-4f2b1e10-2aed-4973-8e00-71ad309b5894 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:43.026202 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-4261b942-36ac-41d3-8bef-b00239869d55 req-4f2b1e10-2aed-4973-8e00-71ad309b5894 service nova] Creating event network-changed:c3c4ea12-20f0-402c-a002-d09aebd27024 for instance d325dc2e-780c-41fe-bdad-ac41805f3534 on hv-cinder-81558 Aug 05 02:21:43.031939 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-4261b942-36ac-41d3-8bef-b00239869d55 req-4f2b1e10-2aed-4973-8e00-71ad309b5894 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077529 Aug 05 02:21:43.033777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 124/251] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:21:43.140846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1822d8c5-565e-45bc-857c-441356daed98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:43.142208 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1822d8c5-565e-45bc-857c-441356daed98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:43.148838 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1822d8c5-565e-45bc-857c-441356daed98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:43.150180 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1822d8c5-565e-45bc-857c-441356daed98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:43.150826 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1822d8c5-565e-45bc-857c-441356daed98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:43.151732 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1822d8c5-565e-45bc-857c-441356daed98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:43.152405 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1822d8c5-565e-45bc-857c-441356daed98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:43.153448 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1822d8c5-565e-45bc-857c-441356daed98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:43.326169 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1822d8c5-565e-45bc-857c-441356daed98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:43.336020 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1822d8c5-565e-45bc-857c-441356daed98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.200184 Aug 05 02:21:43.337040 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 128/252] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:43 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:44.364083 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-63a49e75-180e-4282-9c75-15e7973d174a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:44.365244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-63a49e75-180e-4282-9c75-15e7973d174a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:44.397958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63a49e75-180e-4282-9c75-15e7973d174a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:44.400783 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63a49e75-180e-4282-9c75-15e7973d174a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:44.401457 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63a49e75-180e-4282-9c75-15e7973d174a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:44.403774 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63a49e75-180e-4282-9c75-15e7973d174a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:44.405236 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63a49e75-180e-4282-9c75-15e7973d174a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:44.406444 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63a49e75-180e-4282-9c75-15e7973d174a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:44.640179 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-63a49e75-180e-4282-9c75-15e7973d174a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:44.641503 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-253f4e5b-f66e-42e3-9f83-cf607f32d531 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02b1c5d0-d25a-4af4-9607-fe00cb703090"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:21:44.644171 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-253f4e5b-f66e-42e3-9f83-cf607f32d531 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:44.648601 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-63a49e75-180e-4282-9c75-15e7973d174a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1320 microversion: 2.1 time: 0.293941 Aug 05 02:21:44.651400 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 125/253] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:44 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1320 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:44.660286 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-253f4e5b-f66e-42e3-9f83-cf607f32d531 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:44.661920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-253f4e5b-f66e-42e3-9f83-cf607f32d531 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:44.662565 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-253f4e5b-f66e-42e3-9f83-cf607f32d531 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:44.665336 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-253f4e5b-f66e-42e3-9f83-cf607f32d531 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:44.667936 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-253f4e5b-f66e-42e3-9f83-cf607f32d531 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:44.669461 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-253f4e5b-f66e-42e3-9f83-cf607f32d531 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:45.254451 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-253f4e5b-f66e-42e3-9f83-cf607f32d531 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "POST /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.615996 Aug 05 02:21:45.255442 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 129/254] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Aug 5 02:21:44 2022] POST /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3/os-volume_attachments => generated 194 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:21:45.681189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-47302024-26e2-4b9c-a7cc-d5ef5b95e85a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:45.682466 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-47302024-26e2-4b9c-a7cc-d5ef5b95e85a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:45.685252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=95 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:45.692577 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47302024-26e2-4b9c-a7cc-d5ef5b95e85a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:45.693316 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47302024-26e2-4b9c-a7cc-d5ef5b95e85a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:45.693923 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47302024-26e2-4b9c-a7cc-d5ef5b95e85a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:45.694615 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47302024-26e2-4b9c-a7cc-d5ef5b95e85a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:45.695064 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47302024-26e2-4b9c-a7cc-d5ef5b95e85a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:45.695484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47302024-26e2-4b9c-a7cc-d5ef5b95e85a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:45.860033 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-47302024-26e2-4b9c-a7cc-d5ef5b95e85a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:45.868848 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-47302024-26e2-4b9c-a7cc-d5ef5b95e85a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1515 microversion: 2.1 time: 0.191402 Aug 05 02:21:45.869906 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 126/255] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:45 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1515 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:45.892389 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-28e7f658-2375-45f8-9ac9-d03f21496174 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:21:45.895185 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-28e7f658-2375-45f8-9ac9-d03f21496174 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:45.905771 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-28e7f658-2375-45f8-9ac9-d03f21496174 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:45.906387 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-28e7f658-2375-45f8-9ac9-d03f21496174 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:45.907034 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-28e7f658-2375-45f8-9ac9-d03f21496174 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:45.907818 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-28e7f658-2375-45f8-9ac9-d03f21496174 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:45.908371 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-28e7f658-2375-45f8-9ac9-d03f21496174 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:45.908853 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-28e7f658-2375-45f8-9ac9-d03f21496174 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:45.935437 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-28e7f658-2375-45f8-9ac9-d03f21496174 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lazy-loading 'flavor' on Instance uuid fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:21:46.061654 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-28e7f658-2375-45f8-9ac9-d03f21496174 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "POST /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2/action" status: 200 len: 32 microversion: 2.1 time: 0.173596 Aug 05 02:21:46.064478 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 130/256] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Aug 5 02:21:45 2022] POST /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2/action => generated 32 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 02:21:46.071571 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6d575fbb-e23c-469b-a708-234d15131e6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:46.072171 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6d575fbb-e23c-469b-a708-234d15131e6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:46.079251 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d575fbb-e23c-469b-a708-234d15131e6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:46.079737 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d575fbb-e23c-469b-a708-234d15131e6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:46.080194 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d575fbb-e23c-469b-a708-234d15131e6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:46.081019 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d575fbb-e23c-469b-a708-234d15131e6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:46.081598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d575fbb-e23c-469b-a708-234d15131e6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:46.082016 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d575fbb-e23c-469b-a708-234d15131e6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:46.241803 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6d575fbb-e23c-469b-a708-234d15131e6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:46.251870 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6d575fbb-e23c-469b-a708-234d15131e6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.184006 Aug 05 02:21:46.252490 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 127/257] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:46 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:47.275669 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-60a28b34-0857-4f8c-83f3-a1f5b2770017 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:47.276733 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-60a28b34-0857-4f8c-83f3-a1f5b2770017 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:47.299197 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60a28b34-0857-4f8c-83f3-a1f5b2770017 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:47.300051 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60a28b34-0857-4f8c-83f3-a1f5b2770017 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:47.300590 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60a28b34-0857-4f8c-83f3-a1f5b2770017 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:47.301383 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60a28b34-0857-4f8c-83f3-a1f5b2770017 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:47.301919 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60a28b34-0857-4f8c-83f3-a1f5b2770017 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:47.302558 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60a28b34-0857-4f8c-83f3-a1f5b2770017 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:47.471938 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-60a28b34-0857-4f8c-83f3-a1f5b2770017 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:47.479346 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-60a28b34-0857-4f8c-83f3-a1f5b2770017 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.208737 Aug 05 02:21:47.479899 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 131/258] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:47 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:48.500623 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b563f442-e0ac-4d49-8746-5d44a79a1553 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:48.501907 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b563f442-e0ac-4d49-8746-5d44a79a1553 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:48.508593 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b563f442-e0ac-4d49-8746-5d44a79a1553 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:48.509082 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b563f442-e0ac-4d49-8746-5d44a79a1553 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:48.509515 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b563f442-e0ac-4d49-8746-5d44a79a1553 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:48.510194 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b563f442-e0ac-4d49-8746-5d44a79a1553 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:48.511872 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b563f442-e0ac-4d49-8746-5d44a79a1553 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:48.512784 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b563f442-e0ac-4d49-8746-5d44a79a1553 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:48.703352 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b563f442-e0ac-4d49-8746-5d44a79a1553 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:48.711607 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b563f442-e0ac-4d49-8746-5d44a79a1553 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.215423 Aug 05 02:21:48.712169 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 128/259] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:48 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:49.735997 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-37647046-9efa-4450-afe9-ad85a7e4df78 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:49.737358 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-37647046-9efa-4450-afe9-ad85a7e4df78 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:49.743749 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-37647046-9efa-4450-afe9-ad85a7e4df78 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:49.744349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-37647046-9efa-4450-afe9-ad85a7e4df78 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:49.744869 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-37647046-9efa-4450-afe9-ad85a7e4df78 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:49.745627 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-37647046-9efa-4450-afe9-ad85a7e4df78 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:49.746772 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-37647046-9efa-4450-afe9-ad85a7e4df78 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:49.747896 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-37647046-9efa-4450-afe9-ad85a7e4df78 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:49.921306 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-37647046-9efa-4450-afe9-ad85a7e4df78 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:49.929175 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-37647046-9efa-4450-afe9-ad85a7e4df78 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.199075 Aug 05 02:21:49.929768 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 132/260] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:49 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:50.734398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4a8e1fb4-7001-4bfe-8824-e7e3340f4f19 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Action: 'create', calling method: .version_select at 0x7fa65ca97040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1049348527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4H8t5bdWtCSOiFQEmFK//KiNXmMbgPXvbro3kjxDqWEdZUnMBwrQc88aDqfMG8kbVajsjnL0U9TT0ionrI66vxvX6/IWJieW40pYPjwpxn+TdZfLmBp0/JlY7FROjZ1Q=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:21:50.749785 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-4a8e1fb4-7001-4bfe-8824-e7e3340f4f19 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Getting quotas for project a5d8a01fa4024794b4dde3beebbbd7f1. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:21:50.753508 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-4a8e1fb4-7001-4bfe-8824-e7e3340f4f19 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Getting quotas for user 836dfe4afeef41ab86636b38cb9ccfc1 and project a5d8a01fa4024794b4dde3beebbbd7f1. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:21:50.775266 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4a8e1fb4-7001-4bfe-8824-e7e3340f4f19 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045759 Aug 05 02:21:50.775771 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 129/261] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Aug 5 02:21:50 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:21:50.875146 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-910817809", "imageRef": "5fc23eff-eeac-44e0-8cd1-3914a62d5598", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1049348527", "networks": [{"uuid": "e13b05c9-2865-404d-b1cd-fa40c7ecac7d"}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:21:50.928946 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] validate_networks() for [('e13b05c9-2865-404d-b1cd-fa40c7ecac7d', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:21:50.950730 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5693c17d-0328-4bf3-94de-c75dcd83ef8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:50.951327 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5693c17d-0328-4bf3-94de-c75dcd83ef8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:50.957305 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5693c17d-0328-4bf3-94de-c75dcd83ef8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:50.957777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5693c17d-0328-4bf3-94de-c75dcd83ef8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:50.958209 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5693c17d-0328-4bf3-94de-c75dcd83ef8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:50.958921 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5693c17d-0328-4bf3-94de-c75dcd83ef8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:50.959366 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5693c17d-0328-4bf3-94de-c75dcd83ef8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:50.959779 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5693c17d-0328-4bf3-94de-c75dcd83ef8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:51.099199 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5693c17d-0328-4bf3-94de-c75dcd83ef8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:51.108168 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5693c17d-0328-4bf3-94de-c75dcd83ef8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.161860 Aug 05 02:21:51.108773 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 130/262] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:50 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:21:51.867637 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:21:51.868055 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:21:51.868678 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:21:51.868964 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:21:51.869368 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:21:51.878828 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:51.879440 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:51.879672 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:51.880417 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:51.880869 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:51.881289 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:51.899271 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Getting quotas for project a5d8a01fa4024794b4dde3beebbbd7f1. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:21:51.903811 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Getting quotas for user 836dfe4afeef41ab86636b38cb9ccfc1 and project a5d8a01fa4024794b4dde3beebbbd7f1. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:21:51.914713 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:21:51.916965 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc23eff-eeac-44e0-8cd1-3914a62d5598',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:21:51.971850 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-99f5c2ca-1cd0-4223-b80d-d917a31b4d83 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.100488 Aug 05 02:21:51.972254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 133/263] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:21:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:21:51.985596 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ba4558e7-2205-4be2-80e0-c0f8ff39001b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:51.987199 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ba4558e7-2205-4be2-80e0-c0f8ff39001b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:52.065451 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ba4558e7-2205-4be2-80e0-c0f8ff39001b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:52.072418 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ba4558e7-2205-4be2-80e0-c0f8ff39001b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1258 microversion: 2.1 time: 0.092499 Aug 05 02:21:52.088055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 131/264] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:51 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1258 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:52.133097 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-408edf9c-18e8-418b-96a6-3b03e60083b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:52.135037 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-408edf9c-18e8-418b-96a6-3b03e60083b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:52.144403 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-408edf9c-18e8-418b-96a6-3b03e60083b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:52.145100 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-408edf9c-18e8-418b-96a6-3b03e60083b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:52.145541 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-408edf9c-18e8-418b-96a6-3b03e60083b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:52.146240 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-408edf9c-18e8-418b-96a6-3b03e60083b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:52.146697 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-408edf9c-18e8-418b-96a6-3b03e60083b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:52.147118 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-408edf9c-18e8-418b-96a6-3b03e60083b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:52.388274 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-408edf9c-18e8-418b-96a6-3b03e60083b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:52.398399 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-408edf9c-18e8-418b-96a6-3b03e60083b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.271068 Aug 05 02:21:52.400047 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 134/265] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:52 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:53.095946 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5600411e-1b26-4eb8-8d74-dc7c9373367e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:53.096658 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5600411e-1b26-4eb8-8d74-dc7c9373367e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:53.102548 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5600411e-1b26-4eb8-8d74-dc7c9373367e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:53.103025 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5600411e-1b26-4eb8-8d74-dc7c9373367e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:53.103459 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5600411e-1b26-4eb8-8d74-dc7c9373367e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:53.104143 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5600411e-1b26-4eb8-8d74-dc7c9373367e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:53.104618 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5600411e-1b26-4eb8-8d74-dc7c9373367e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:53.105043 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5600411e-1b26-4eb8-8d74-dc7c9373367e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:53.167429 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5600411e-1b26-4eb8-8d74-dc7c9373367e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:53.175331 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5600411e-1b26-4eb8-8d74-dc7c9373367e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1310 microversion: 2.1 time: 0.083520 Aug 05 02:21:53.175891 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 132/266] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:53 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:53.422141 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9f055cb8-3f2c-46dd-8624-03caaaaeea8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:53.422745 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9f055cb8-3f2c-46dd-8624-03caaaaeea8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:53.432135 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f055cb8-3f2c-46dd-8624-03caaaaeea8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:53.437783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f055cb8-3f2c-46dd-8624-03caaaaeea8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:53.438248 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f055cb8-3f2c-46dd-8624-03caaaaeea8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:53.438981 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f055cb8-3f2c-46dd-8624-03caaaaeea8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:53.439453 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f055cb8-3f2c-46dd-8624-03caaaaeea8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:53.439964 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f055cb8-3f2c-46dd-8624-03caaaaeea8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:53.768034 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9f055cb8-3f2c-46dd-8624-03caaaaeea8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:53.775423 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9f055cb8-3f2c-46dd-8624-03caaaaeea8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.357815 Aug 05 02:21:53.775989 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 135/267] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:53 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:54.198124 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-710c1fe8-91d6-4c42-b7c4-2740cfdfb899 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:54.200301 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-710c1fe8-91d6-4c42-b7c4-2740cfdfb899 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:54.206895 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-710c1fe8-91d6-4c42-b7c4-2740cfdfb899 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:54.207773 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-710c1fe8-91d6-4c42-b7c4-2740cfdfb899 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:54.208392 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-710c1fe8-91d6-4c42-b7c4-2740cfdfb899 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:54.209377 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-710c1fe8-91d6-4c42-b7c4-2740cfdfb899 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:54.210013 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-710c1fe8-91d6-4c42-b7c4-2740cfdfb899 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:54.210672 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-710c1fe8-91d6-4c42-b7c4-2740cfdfb899 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:54.388381 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-710c1fe8-91d6-4c42-b7c4-2740cfdfb899 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:54.415075 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-710c1fe8-91d6-4c42-b7c4-2740cfdfb899 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.222660 Aug 05 02:21:54.415657 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 133/268] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:54 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:54.808847 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b4e7bad0-961f-43c3-a901-3a435b6d0fa4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:54.819096 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b4e7bad0-961f-43c3-a901-3a435b6d0fa4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:54.847170 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4e7bad0-961f-43c3-a901-3a435b6d0fa4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:54.848182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4e7bad0-961f-43c3-a901-3a435b6d0fa4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:54.848979 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4e7bad0-961f-43c3-a901-3a435b6d0fa4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:54.849971 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4e7bad0-961f-43c3-a901-3a435b6d0fa4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:54.850576 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4e7bad0-961f-43c3-a901-3a435b6d0fa4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:54.851327 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4e7bad0-961f-43c3-a901-3a435b6d0fa4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:55.157249 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b4e7bad0-961f-43c3-a901-3a435b6d0fa4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:55.171028 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b4e7bad0-961f-43c3-a901-3a435b6d0fa4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.372800 Aug 05 02:21:55.175597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 136/269] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:54 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:55.436928 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ffe94b48-1530-4b5d-bf09-c02cef1ac28b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:55.437527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ffe94b48-1530-4b5d-bf09-c02cef1ac28b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:55.444241 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffe94b48-1530-4b5d-bf09-c02cef1ac28b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:55.444805 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffe94b48-1530-4b5d-bf09-c02cef1ac28b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:55.445246 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffe94b48-1530-4b5d-bf09-c02cef1ac28b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:55.445951 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffe94b48-1530-4b5d-bf09-c02cef1ac28b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:55.446410 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffe94b48-1530-4b5d-bf09-c02cef1ac28b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:55.446840 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffe94b48-1530-4b5d-bf09-c02cef1ac28b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:55.644586 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ffe94b48-1530-4b5d-bf09-c02cef1ac28b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:55.657965 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ffe94b48-1530-4b5d-bf09-c02cef1ac28b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.224695 Aug 05 02:21:55.660790 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 134/270] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:55 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:56.192885 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-56b47f32-7329-4ce3-9802-78e7a105e6a4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:56.194067 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-56b47f32-7329-4ce3-9802-78e7a105e6a4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:56.202213 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-56b47f32-7329-4ce3-9802-78e7a105e6a4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:56.203001 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-56b47f32-7329-4ce3-9802-78e7a105e6a4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:56.203707 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-56b47f32-7329-4ce3-9802-78e7a105e6a4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:56.204666 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-56b47f32-7329-4ce3-9802-78e7a105e6a4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:56.205309 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-56b47f32-7329-4ce3-9802-78e7a105e6a4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:56.206033 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-56b47f32-7329-4ce3-9802-78e7a105e6a4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:56.211107 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:56.416860 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-56b47f32-7329-4ce3-9802-78e7a105e6a4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:56.428358 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-56b47f32-7329-4ce3-9802-78e7a105e6a4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.239180 Aug 05 02:21:56.429519 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 137/271] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:56 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:56.684735 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-db0f81d8-661a-470b-abab-456a45f8a10c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:56.685495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-db0f81d8-661a-470b-abab-456a45f8a10c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:56.691618 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db0f81d8-661a-470b-abab-456a45f8a10c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:56.692101 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db0f81d8-661a-470b-abab-456a45f8a10c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:56.692563 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db0f81d8-661a-470b-abab-456a45f8a10c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:56.693255 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db0f81d8-661a-470b-abab-456a45f8a10c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:56.693847 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db0f81d8-661a-470b-abab-456a45f8a10c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:56.694275 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db0f81d8-661a-470b-abab-456a45f8a10c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:56.904223 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-db0f81d8-661a-470b-abab-456a45f8a10c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:56.912281 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-db0f81d8-661a-470b-abab-456a45f8a10c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.233029 Aug 05 02:21:56.913633 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 135/272] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:56 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:57.450625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-94ac64da-e99a-48e4-ab68-55bbfd24e14b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:57.452054 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-94ac64da-e99a-48e4-ab68-55bbfd24e14b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:57.459384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-94ac64da-e99a-48e4-ab68-55bbfd24e14b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:57.459872 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-94ac64da-e99a-48e4-ab68-55bbfd24e14b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:57.460308 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-94ac64da-e99a-48e4-ab68-55bbfd24e14b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:57.461033 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-94ac64da-e99a-48e4-ab68-55bbfd24e14b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:57.461976 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-94ac64da-e99a-48e4-ab68-55bbfd24e14b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:57.462409 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-94ac64da-e99a-48e4-ab68-55bbfd24e14b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:57.618430 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-94ac64da-e99a-48e4-ab68-55bbfd24e14b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:57.632229 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-94ac64da-e99a-48e4-ab68-55bbfd24e14b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.186661 Aug 05 02:21:57.634528 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 138/273] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:57 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:57.934082 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5f97599d-1796-4ded-92d9-3726d8381ff5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:57.935424 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5f97599d-1796-4ded-92d9-3726d8381ff5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:57.942108 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f97599d-1796-4ded-92d9-3726d8381ff5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:57.942764 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f97599d-1796-4ded-92d9-3726d8381ff5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:57.943271 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f97599d-1796-4ded-92d9-3726d8381ff5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:57.944048 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f97599d-1796-4ded-92d9-3726d8381ff5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:57.944649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f97599d-1796-4ded-92d9-3726d8381ff5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:57.945132 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f97599d-1796-4ded-92d9-3726d8381ff5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:57.949851 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:58.104387 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5f97599d-1796-4ded-92d9-3726d8381ff5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:58.112705 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5f97599d-1796-4ded-92d9-3726d8381ff5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.182911 Aug 05 02:21:58.113276 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 136/274] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:57 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:58.658647 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-57ad59f8-ff99-44fd-acc5-78cd8a0c23d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:58.659647 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-57ad59f8-ff99-44fd-acc5-78cd8a0c23d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:58.666134 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57ad59f8-ff99-44fd-acc5-78cd8a0c23d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:58.666627 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57ad59f8-ff99-44fd-acc5-78cd8a0c23d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:58.667045 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57ad59f8-ff99-44fd-acc5-78cd8a0c23d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:58.668737 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57ad59f8-ff99-44fd-acc5-78cd8a0c23d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:58.669422 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57ad59f8-ff99-44fd-acc5-78cd8a0c23d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:58.669770 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57ad59f8-ff99-44fd-acc5-78cd8a0c23d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:58.990678 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-57ad59f8-ff99-44fd-acc5-78cd8a0c23d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:58.998704 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-57ad59f8-ff99-44fd-acc5-78cd8a0c23d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.347812 Aug 05 02:21:58.999484 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 139/275] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:58 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:21:59.137293 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-15b3d81b-4257-4759-aa8d-66e2629d0b3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:21:59.137943 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-15b3d81b-4257-4759-aa8d-66e2629d0b3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:21:59.144592 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-15b3d81b-4257-4759-aa8d-66e2629d0b3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:59.145103 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-15b3d81b-4257-4759-aa8d-66e2629d0b3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:59.145514 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-15b3d81b-4257-4759-aa8d-66e2629d0b3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:59.146216 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-15b3d81b-4257-4759-aa8d-66e2629d0b3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:21:59.146713 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-15b3d81b-4257-4759-aa8d-66e2629d0b3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:21:59.147085 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-15b3d81b-4257-4759-aa8d-66e2629d0b3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:21:59.319876 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-15b3d81b-4257-4759-aa8d-66e2629d0b3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:21:59.331781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-15b3d81b-4257-4759-aa8d-66e2629d0b3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.200020 Aug 05 02:21:59.333992 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 137/276] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:21:59 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:00.025729 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-53669174-6291-4f5c-9019-64637c1480f8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:00.026644 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-53669174-6291-4f5c-9019-64637c1480f8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:00.034010 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53669174-6291-4f5c-9019-64637c1480f8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:00.034556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53669174-6291-4f5c-9019-64637c1480f8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:00.034908 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53669174-6291-4f5c-9019-64637c1480f8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:00.035612 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53669174-6291-4f5c-9019-64637c1480f8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:00.036064 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53669174-6291-4f5c-9019-64637c1480f8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:00.036514 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-53669174-6291-4f5c-9019-64637c1480f8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:00.182562 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-53669174-6291-4f5c-9019-64637c1480f8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:00.191880 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-53669174-6291-4f5c-9019-64637c1480f8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.174240 Aug 05 02:22:00.192972 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 140/277] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:00 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:00.367043 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6d069fdd-e646-4b1f-8e65-7b2c8c13626d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:00.367651 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6d069fdd-e646-4b1f-8e65-7b2c8c13626d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:00.380957 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d069fdd-e646-4b1f-8e65-7b2c8c13626d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:00.381449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d069fdd-e646-4b1f-8e65-7b2c8c13626d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:00.381904 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d069fdd-e646-4b1f-8e65-7b2c8c13626d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:00.382572 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d069fdd-e646-4b1f-8e65-7b2c8c13626d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:00.383197 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d069fdd-e646-4b1f-8e65-7b2c8c13626d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:00.385761 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6d069fdd-e646-4b1f-8e65-7b2c8c13626d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:00.537486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6d069fdd-e646-4b1f-8e65-7b2c8c13626d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:00.546165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6d069fdd-e646-4b1f-8e65-7b2c8c13626d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.182906 Aug 05 02:22:00.547086 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 138/278] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:00 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:01.216862 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-27538477-edd0-4d60-8c2e-d74728c02146 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:01.217568 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-27538477-edd0-4d60-8c2e-d74728c02146 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:01.225607 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27538477-edd0-4d60-8c2e-d74728c02146 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:01.226091 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27538477-edd0-4d60-8c2e-d74728c02146 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:01.226579 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27538477-edd0-4d60-8c2e-d74728c02146 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:01.227276 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27538477-edd0-4d60-8c2e-d74728c02146 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:01.227735 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27538477-edd0-4d60-8c2e-d74728c02146 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:01.228160 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27538477-edd0-4d60-8c2e-d74728c02146 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:01.402977 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-27538477-edd0-4d60-8c2e-d74728c02146 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:01.411545 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-27538477-edd0-4d60-8c2e-d74728c02146 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.199251 Aug 05 02:22:01.412471 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 141/279] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:01 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:01.567948 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-286f2a8f-c37c-4251-a1fe-1fbed9ebbe92 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:01.569299 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-286f2a8f-c37c-4251-a1fe-1fbed9ebbe92 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:01.575977 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-286f2a8f-c37c-4251-a1fe-1fbed9ebbe92 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:01.576626 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-286f2a8f-c37c-4251-a1fe-1fbed9ebbe92 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:01.577065 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-286f2a8f-c37c-4251-a1fe-1fbed9ebbe92 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:01.577761 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-286f2a8f-c37c-4251-a1fe-1fbed9ebbe92 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:01.578214 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-286f2a8f-c37c-4251-a1fe-1fbed9ebbe92 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:01.578661 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-286f2a8f-c37c-4251-a1fe-1fbed9ebbe92 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:01.771585 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-286f2a8f-c37c-4251-a1fe-1fbed9ebbe92 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:01.781428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-286f2a8f-c37c-4251-a1fe-1fbed9ebbe92 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.216758 Aug 05 02:22:01.783558 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 139/280] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:01 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:02.436667 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7fb3fe36-ac01-4e4a-a463-0698b9f18b2b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:02.437245 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7fb3fe36-ac01-4e4a-a463-0698b9f18b2b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:02.443038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:02.443690 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:02.451124 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7fb3fe36-ac01-4e4a-a463-0698b9f18b2b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:02.451596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7fb3fe36-ac01-4e4a-a463-0698b9f18b2b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:02.452025 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7fb3fe36-ac01-4e4a-a463-0698b9f18b2b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:02.452736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7fb3fe36-ac01-4e4a-a463-0698b9f18b2b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:02.453182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7fb3fe36-ac01-4e4a-a463-0698b9f18b2b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:02.453598 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7fb3fe36-ac01-4e4a-a463-0698b9f18b2b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:02.604050 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7fb3fe36-ac01-4e4a-a463-0698b9f18b2b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:02.611990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7fb3fe36-ac01-4e4a-a463-0698b9f18b2b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.180171 Aug 05 02:22:02.612572 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 142/281] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:02 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:02.811144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d3e0c3fb-3860-451c-b4af-5a960ef8483e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:02.811144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d3e0c3fb-3860-451c-b4af-5a960ef8483e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:02.814563 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:02.816694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3e0c3fb-3860-451c-b4af-5a960ef8483e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:02.817185 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3e0c3fb-3860-451c-b4af-5a960ef8483e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:02.820366 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3e0c3fb-3860-451c-b4af-5a960ef8483e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:02.820366 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3e0c3fb-3860-451c-b4af-5a960ef8483e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:02.820366 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3e0c3fb-3860-451c-b4af-5a960ef8483e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:02.820366 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3e0c3fb-3860-451c-b4af-5a960ef8483e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:02.969670 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d3e0c3fb-3860-451c-b4af-5a960ef8483e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:02.978632 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d3e0c3fb-3860-451c-b4af-5a960ef8483e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.174635 Aug 05 02:22:02.979255 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 140/282] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:02 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:03.636520 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7590f6cb-6eb9-448b-bb9f-24ba86fb2eb2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:03.636520 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7590f6cb-6eb9-448b-bb9f-24ba86fb2eb2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:03.643105 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7590f6cb-6eb9-448b-bb9f-24ba86fb2eb2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:03.643923 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7590f6cb-6eb9-448b-bb9f-24ba86fb2eb2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:03.644282 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7590f6cb-6eb9-448b-bb9f-24ba86fb2eb2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:03.645115 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7590f6cb-6eb9-448b-bb9f-24ba86fb2eb2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:03.645576 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7590f6cb-6eb9-448b-bb9f-24ba86fb2eb2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:03.646005 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7590f6cb-6eb9-448b-bb9f-24ba86fb2eb2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:03.885678 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7590f6cb-6eb9-448b-bb9f-24ba86fb2eb2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:03.894449 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7590f6cb-6eb9-448b-bb9f-24ba86fb2eb2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.264859 Aug 05 02:22:03.895053 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 143/283] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:03 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:04.002159 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-73ea2aff-0f7d-447f-838b-e42464e012c5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:04.002889 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-73ea2aff-0f7d-447f-838b-e42464e012c5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:04.025830 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73ea2aff-0f7d-447f-838b-e42464e012c5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:04.028218 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73ea2aff-0f7d-447f-838b-e42464e012c5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:04.029006 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73ea2aff-0f7d-447f-838b-e42464e012c5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:04.029893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73ea2aff-0f7d-447f-838b-e42464e012c5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:04.030364 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73ea2aff-0f7d-447f-838b-e42464e012c5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:04.030885 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73ea2aff-0f7d-447f-838b-e42464e012c5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:04.194142 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-73ea2aff-0f7d-447f-838b-e42464e012c5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:04.201724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-73ea2aff-0f7d-447f-838b-e42464e012c5 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.204655 Aug 05 02:22:04.202284 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 141/284] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:03 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:04.926588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-eb1516fd-9715-4822-bc68-bec1e03816b3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:04.927712 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-eb1516fd-9715-4822-bc68-bec1e03816b3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:04.935470 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb1516fd-9715-4822-bc68-bec1e03816b3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:04.935956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb1516fd-9715-4822-bc68-bec1e03816b3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:04.936571 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb1516fd-9715-4822-bc68-bec1e03816b3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:04.937298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb1516fd-9715-4822-bc68-bec1e03816b3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:04.937750 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb1516fd-9715-4822-bc68-bec1e03816b3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:04.938166 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb1516fd-9715-4822-bc68-bec1e03816b3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:05.174618 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eb1516fd-9715-4822-bc68-bec1e03816b3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:05.184097 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-eb1516fd-9715-4822-bc68-bec1e03816b3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.260684 Aug 05 02:22:05.186253 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 144/285] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:04 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:05.224809 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-056e3e43-6c46-4c32-b800-b9c63f61769c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:05.226216 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-056e3e43-6c46-4c32-b800-b9c63f61769c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:05.233411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-056e3e43-6c46-4c32-b800-b9c63f61769c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:05.234067 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-056e3e43-6c46-4c32-b800-b9c63f61769c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:05.234481 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-056e3e43-6c46-4c32-b800-b9c63f61769c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:05.235215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-056e3e43-6c46-4c32-b800-b9c63f61769c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:05.235672 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-056e3e43-6c46-4c32-b800-b9c63f61769c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:05.236366 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-056e3e43-6c46-4c32-b800-b9c63f61769c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:05.398533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-056e3e43-6c46-4c32-b800-b9c63f61769c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:05.425127 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-056e3e43-6c46-4c32-b800-b9c63f61769c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.204620 Aug 05 02:22:05.441859 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 142/286] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:05 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:06.209222 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-12cde287-02af-4ad4-a169-ce6a7195d94a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:06.210031 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-12cde287-02af-4ad4-a169-ce6a7195d94a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:06.217363 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-12cde287-02af-4ad4-a169-ce6a7195d94a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:06.217850 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-12cde287-02af-4ad4-a169-ce6a7195d94a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:06.218284 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-12cde287-02af-4ad4-a169-ce6a7195d94a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:06.218998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-12cde287-02af-4ad4-a169-ce6a7195d94a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:06.219552 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-12cde287-02af-4ad4-a169-ce6a7195d94a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:06.220011 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-12cde287-02af-4ad4-a169-ce6a7195d94a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:06.400201 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-12cde287-02af-4ad4-a169-ce6a7195d94a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:06.408861 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-12cde287-02af-4ad4-a169-ce6a7195d94a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.203255 Aug 05 02:22:06.409527 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 145/287] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:06 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:06.451152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d7f6f81e-ef5c-45cf-aa28-688d7cf6d080 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:06.453711 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d7f6f81e-ef5c-45cf-aa28-688d7cf6d080 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:06.461994 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7f6f81e-ef5c-45cf-aa28-688d7cf6d080 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:06.462725 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7f6f81e-ef5c-45cf-aa28-688d7cf6d080 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:06.463262 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7f6f81e-ef5c-45cf-aa28-688d7cf6d080 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:06.464720 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7f6f81e-ef5c-45cf-aa28-688d7cf6d080 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:06.465182 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7f6f81e-ef5c-45cf-aa28-688d7cf6d080 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:06.465603 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7f6f81e-ef5c-45cf-aa28-688d7cf6d080 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:06.618968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d7f6f81e-ef5c-45cf-aa28-688d7cf6d080 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:06.627312 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d7f6f81e-ef5c-45cf-aa28-688d7cf6d080 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.182699 Aug 05 02:22:06.628087 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 143/288] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:06 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:07.430982 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0d313d1e-7c4f-4e16-8912-68e8a4ee1ef4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:07.431942 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0d313d1e-7c4f-4e16-8912-68e8a4ee1ef4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:07.438957 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d313d1e-7c4f-4e16-8912-68e8a4ee1ef4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:07.439535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d313d1e-7c4f-4e16-8912-68e8a4ee1ef4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:07.439972 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d313d1e-7c4f-4e16-8912-68e8a4ee1ef4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:07.440687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d313d1e-7c4f-4e16-8912-68e8a4ee1ef4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:07.441135 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d313d1e-7c4f-4e16-8912-68e8a4ee1ef4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:07.441557 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d313d1e-7c4f-4e16-8912-68e8a4ee1ef4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:07.582603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0d313d1e-7c4f-4e16-8912-68e8a4ee1ef4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:07.591029 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0d313d1e-7c4f-4e16-8912-68e8a4ee1ef4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.164308 Aug 05 02:22:07.591597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 146/289] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:07 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:07.648277 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-77d594ae-e948-40a5-8c3d-65a48ea63e9c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:07.649010 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-77d594ae-e948-40a5-8c3d-65a48ea63e9c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:07.655378 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d594ae-e948-40a5-8c3d-65a48ea63e9c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:07.655865 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d594ae-e948-40a5-8c3d-65a48ea63e9c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:07.656300 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d594ae-e948-40a5-8c3d-65a48ea63e9c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:07.657119 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d594ae-e948-40a5-8c3d-65a48ea63e9c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:07.657717 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d594ae-e948-40a5-8c3d-65a48ea63e9c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:07.658147 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d594ae-e948-40a5-8c3d-65a48ea63e9c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:07.790417 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-77d594ae-e948-40a5-8c3d-65a48ea63e9c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:07.798691 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-77d594ae-e948-40a5-8c3d-65a48ea63e9c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.154237 Aug 05 02:22:07.799266 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 144/290] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:07 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:08.356676 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1780241914", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452", "networks": [{"uuid": "7e162cf4-1761-488b-a0c2-fc8d03640ad2"}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:22:08.419368 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] validate_networks() for [('7e162cf4-1761-488b-a0c2-fc8d03640ad2', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:22:08.612042 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ffa3063c-ec3a-4394-bad2-6d02c7ef9181 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:08.612740 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ffa3063c-ec3a-4394-bad2-6d02c7ef9181 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:08.618722 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffa3063c-ec3a-4394-bad2-6d02c7ef9181 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:08.619208 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffa3063c-ec3a-4394-bad2-6d02c7ef9181 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:08.619637 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffa3063c-ec3a-4394-bad2-6d02c7ef9181 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:08.620982 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffa3063c-ec3a-4394-bad2-6d02c7ef9181 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:08.621435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffa3063c-ec3a-4394-bad2-6d02c7ef9181 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:08.621851 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffa3063c-ec3a-4394-bad2-6d02c7ef9181 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:08.762750 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ffa3063c-ec3a-4394-bad2-6d02c7ef9181 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:08.770890 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ffa3063c-ec3a-4394-bad2-6d02c7ef9181 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.162767 Aug 05 02:22:08.771581 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 145/291] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:08 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:08.820505 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-21b050c3-d5d8-4e21-9a29-cb17cd1e2d88 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:08.821214 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-21b050c3-d5d8-4e21-9a29-cb17cd1e2d88 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:08.827488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21b050c3-d5d8-4e21-9a29-cb17cd1e2d88 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:08.827981 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21b050c3-d5d8-4e21-9a29-cb17cd1e2d88 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:08.828444 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21b050c3-d5d8-4e21-9a29-cb17cd1e2d88 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:08.829323 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21b050c3-d5d8-4e21-9a29-cb17cd1e2d88 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:08.830125 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21b050c3-d5d8-4e21-9a29-cb17cd1e2d88 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:08.830883 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21b050c3-d5d8-4e21-9a29-cb17cd1e2d88 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:08.951880 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:22:08.952407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:22:08.952822 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:22:08.953383 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:22:08.953830 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:22:08.963670 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:08.963670 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:08.964844 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:08.965579 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:08.966034 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:08.966486 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:08.967733 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-21b050c3-d5d8-4e21-9a29-cb17cd1e2d88 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:08.975819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-21b050c3-d5d8-4e21-9a29-cb17cd1e2d88 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.159218 Aug 05 02:22:08.976417 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 146/292] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:08 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:08.983501 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Getting quotas for project 14962cc915f647cc916994ec724de454. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:22:08.987263 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Getting quotas for user 47d90567551e4cfb9bcc974e11d4e42c and project 14962cc915f647cc916994ec724de454. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:22:08.999281 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:22:09.001321 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:22:09.044867 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e1dfcf54-db95-4721-9ba1-e77e9407083c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692439 Aug 05 02:22:09.045498 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 147/293] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:22:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:22:09.055992 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c1db2502-1c85-4162-b4b8-7c619fbd86de tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:09.056624 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c1db2502-1c85-4162-b4b8-7c619fbd86de tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:09.109487 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c1db2502-1c85-4162-b4b8-7c619fbd86de tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:09.116133 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c1db2502-1c85-4162-b4b8-7c619fbd86de tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1214 microversion: 2.1 time: 0.063960 Aug 05 02:22:09.116728 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 147/294] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:09 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:09.794812 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-eb6ec905-4e96-4c9f-9185-596fc05483ac tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:09.795433 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-eb6ec905-4e96-4c9f-9185-596fc05483ac tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:09.797320 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:09.802939 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb6ec905-4e96-4c9f-9185-596fc05483ac tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:09.803425 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb6ec905-4e96-4c9f-9185-596fc05483ac tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:09.803859 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb6ec905-4e96-4c9f-9185-596fc05483ac tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:09.804578 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb6ec905-4e96-4c9f-9185-596fc05483ac tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:09.805032 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb6ec905-4e96-4c9f-9185-596fc05483ac tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:09.805455 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eb6ec905-4e96-4c9f-9185-596fc05483ac tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:09.940052 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eb6ec905-4e96-4c9f-9185-596fc05483ac tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:09.947399 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-eb6ec905-4e96-4c9f-9185-596fc05483ac tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.157905 Aug 05 02:22:09.947976 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 148/295] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:09 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:09.997028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d255449c-1740-483c-9fb1-e135d3dd4eb1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:09.997744 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d255449c-1740-483c-9fb1-e135d3dd4eb1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:10.003714 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d255449c-1740-483c-9fb1-e135d3dd4eb1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:10.004196 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d255449c-1740-483c-9fb1-e135d3dd4eb1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:10.004677 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d255449c-1740-483c-9fb1-e135d3dd4eb1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:10.005361 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d255449c-1740-483c-9fb1-e135d3dd4eb1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:10.005812 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d255449c-1740-483c-9fb1-e135d3dd4eb1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:10.006232 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d255449c-1740-483c-9fb1-e135d3dd4eb1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:10.136212 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3c937580-c8c8-41d9-933c-9bf8e3470015 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:10.136852 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3c937580-c8c8-41d9-933c-9bf8e3470015 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:10.143278 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c937580-c8c8-41d9-933c-9bf8e3470015 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:10.143764 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c937580-c8c8-41d9-933c-9bf8e3470015 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:10.144193 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c937580-c8c8-41d9-933c-9bf8e3470015 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:10.144940 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c937580-c8c8-41d9-933c-9bf8e3470015 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:10.145392 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c937580-c8c8-41d9-933c-9bf8e3470015 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:10.145814 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c937580-c8c8-41d9-933c-9bf8e3470015 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:10.153973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d255449c-1740-483c-9fb1-e135d3dd4eb1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:10.161514 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d255449c-1740-483c-9fb1-e135d3dd4eb1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.168822 Aug 05 02:22:10.162090 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 148/296] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:09 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:10.209876 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3c937580-c8c8-41d9-933c-9bf8e3470015 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:10.217263 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3c937580-c8c8-41d9-933c-9bf8e3470015 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1218 microversion: 2.1 time: 0.085238 Aug 05 02:22:10.217824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 149/297] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:10 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:10.968247 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-45733638-be45-43b5-bf75-31f193d555f0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:10.968895 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-45733638-be45-43b5-bf75-31f193d555f0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:10.975115 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45733638-be45-43b5-bf75-31f193d555f0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:10.975687 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45733638-be45-43b5-bf75-31f193d555f0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:10.976143 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45733638-be45-43b5-bf75-31f193d555f0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:10.976859 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45733638-be45-43b5-bf75-31f193d555f0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:10.977317 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45733638-be45-43b5-bf75-31f193d555f0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:10.977743 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-45733638-be45-43b5-bf75-31f193d555f0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:11.118654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-45733638-be45-43b5-bf75-31f193d555f0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:11.127636 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-45733638-be45-43b5-bf75-31f193d555f0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.163363 Aug 05 02:22:11.128203 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 149/298] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:10 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:11.182836 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-599b70c8-c3eb-45b0-89f1-173a08fc5ab3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:11.183464 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-599b70c8-c3eb-45b0-89f1-173a08fc5ab3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:11.189849 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-599b70c8-c3eb-45b0-89f1-173a08fc5ab3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:11.190316 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-599b70c8-c3eb-45b0-89f1-173a08fc5ab3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:11.190752 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-599b70c8-c3eb-45b0-89f1-173a08fc5ab3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:11.191436 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-599b70c8-c3eb-45b0-89f1-173a08fc5ab3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:11.191885 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-599b70c8-c3eb-45b0-89f1-173a08fc5ab3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:11.192305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-599b70c8-c3eb-45b0-89f1-173a08fc5ab3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:11.238217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b3213c54-2290-4999-8cf0-8ba0c8ec5077 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:11.238815 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b3213c54-2290-4999-8cf0-8ba0c8ec5077 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:11.244782 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3213c54-2290-4999-8cf0-8ba0c8ec5077 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:11.245256 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3213c54-2290-4999-8cf0-8ba0c8ec5077 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:11.246221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3213c54-2290-4999-8cf0-8ba0c8ec5077 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:11.246897 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3213c54-2290-4999-8cf0-8ba0c8ec5077 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:11.247334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3213c54-2290-4999-8cf0-8ba0c8ec5077 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:11.247750 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3213c54-2290-4999-8cf0-8ba0c8ec5077 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:11.307177 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b3213c54-2290-4999-8cf0-8ba0c8ec5077 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:11.315217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b3213c54-2290-4999-8cf0-8ba0c8ec5077 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1218 microversion: 2.1 time: 0.080822 Aug 05 02:22:11.315780 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 150/299] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:11 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:11.430882 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-599b70c8-c3eb-45b0-89f1-173a08fc5ab3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:11.438175 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-599b70c8-c3eb-45b0-89f1-173a08fc5ab3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.259154 Aug 05 02:22:11.438710 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 150/300] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:11 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:11.644077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-7fdf5547-4918-4340-a3f2-641e6b163789 req-7a187e07-1e27-4f47-a11c-64afe65821a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c8e9d9-004f-4693-a78d-77027c30aede", "tag": "9017b9e3-fdca-4fff-a053-ec122ab62248"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:22:11.654527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7fdf5547-4918-4340-a3f2-641e6b163789 req-7a187e07-1e27-4f47-a11c-64afe65821a0 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:11.655007 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7fdf5547-4918-4340-a3f2-641e6b163789 req-7a187e07-1e27-4f47-a11c-64afe65821a0 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:11.655549 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7fdf5547-4918-4340-a3f2-641e6b163789 req-7a187e07-1e27-4f47-a11c-64afe65821a0 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:11.666318 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-7fdf5547-4918-4340-a3f2-641e6b163789 req-7a187e07-1e27-4f47-a11c-64afe65821a0 service nova] Creating event network-changed:9017b9e3-fdca-4fff-a053-ec122ab62248 for instance d5c8e9d9-004f-4693-a78d-77027c30aede on hv-cinder-81558 Aug 05 02:22:11.671251 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-7fdf5547-4918-4340-a3f2-641e6b163789 req-7a187e07-1e27-4f47-a11c-64afe65821a0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030837 Aug 05 02:22:11.671834 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 151/301] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:22:12.148099 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-17c04cef-9e03-4035-aa8b-20c801b9d028 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:12.148737 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-17c04cef-9e03-4035-aa8b-20c801b9d028 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:12.154819 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17c04cef-9e03-4035-aa8b-20c801b9d028 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:12.155522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17c04cef-9e03-4035-aa8b-20c801b9d028 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:12.155721 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17c04cef-9e03-4035-aa8b-20c801b9d028 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:12.156436 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17c04cef-9e03-4035-aa8b-20c801b9d028 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:12.156895 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17c04cef-9e03-4035-aa8b-20c801b9d028 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:12.157319 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17c04cef-9e03-4035-aa8b-20c801b9d028 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:12.293330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-17c04cef-9e03-4035-aa8b-20c801b9d028 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:12.300656 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-17c04cef-9e03-4035-aa8b-20c801b9d028 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.156354 Aug 05 02:22:12.301215 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 151/302] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:12 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:12.335350 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-43df378a-9853-459a-b5a7-096b9da7f50e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:12.336030 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-43df378a-9853-459a-b5a7-096b9da7f50e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:12.342627 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43df378a-9853-459a-b5a7-096b9da7f50e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:12.343100 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43df378a-9853-459a-b5a7-096b9da7f50e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:12.343527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43df378a-9853-459a-b5a7-096b9da7f50e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:12.344204 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43df378a-9853-459a-b5a7-096b9da7f50e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:12.344671 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43df378a-9853-459a-b5a7-096b9da7f50e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:12.345354 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43df378a-9853-459a-b5a7-096b9da7f50e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:12.410010 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-43df378a-9853-459a-b5a7-096b9da7f50e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:12.417323 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-43df378a-9853-459a-b5a7-096b9da7f50e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1218 microversion: 2.1 time: 0.086209 Aug 05 02:22:12.418040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 152/303] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:12 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:12.459202 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8f5f9eaa-87cf-47dc-8c08-f8fb7dbe361e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:12.459809 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8f5f9eaa-87cf-47dc-8c08-f8fb7dbe361e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:12.466378 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f5f9eaa-87cf-47dc-8c08-f8fb7dbe361e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:12.466858 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f5f9eaa-87cf-47dc-8c08-f8fb7dbe361e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:12.467291 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f5f9eaa-87cf-47dc-8c08-f8fb7dbe361e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:12.467970 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f5f9eaa-87cf-47dc-8c08-f8fb7dbe361e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:12.468444 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f5f9eaa-87cf-47dc-8c08-f8fb7dbe361e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:12.468867 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f5f9eaa-87cf-47dc-8c08-f8fb7dbe361e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:12.592361 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8f5f9eaa-87cf-47dc-8c08-f8fb7dbe361e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:12.599802 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8f5f9eaa-87cf-47dc-8c08-f8fb7dbe361e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.144650 Aug 05 02:22:12.600396 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 152/304] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:12 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:13.320381 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2ef45b91-c4ee-4b5a-bba5-4fbb2de0bfce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:13.321013 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2ef45b91-c4ee-4b5a-bba5-4fbb2de0bfce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:13.327573 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ef45b91-c4ee-4b5a-bba5-4fbb2de0bfce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:13.328056 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ef45b91-c4ee-4b5a-bba5-4fbb2de0bfce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:13.328517 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ef45b91-c4ee-4b5a-bba5-4fbb2de0bfce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:13.329206 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ef45b91-c4ee-4b5a-bba5-4fbb2de0bfce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:13.329659 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ef45b91-c4ee-4b5a-bba5-4fbb2de0bfce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:13.330079 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ef45b91-c4ee-4b5a-bba5-4fbb2de0bfce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:13.438564 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0cc4203f-3b26-4e9c-adfd-e2aab478e14c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:13.439160 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0cc4203f-3b26-4e9c-adfd-e2aab478e14c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:13.445595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0cc4203f-3b26-4e9c-adfd-e2aab478e14c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:13.446072 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0cc4203f-3b26-4e9c-adfd-e2aab478e14c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:13.446497 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0cc4203f-3b26-4e9c-adfd-e2aab478e14c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:13.447248 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0cc4203f-3b26-4e9c-adfd-e2aab478e14c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:13.447630 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0cc4203f-3b26-4e9c-adfd-e2aab478e14c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:13.448043 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0cc4203f-3b26-4e9c-adfd-e2aab478e14c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:13.458350 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2ef45b91-c4ee-4b5a-bba5-4fbb2de0bfce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:13.465691 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2ef45b91-c4ee-4b5a-bba5-4fbb2de0bfce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.149117 Aug 05 02:22:13.466245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 153/305] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:13 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:13.510479 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0cc4203f-3b26-4e9c-adfd-e2aab478e14c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:13.518988 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0cc4203f-3b26-4e9c-adfd-e2aab478e14c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1218 microversion: 2.1 time: 0.084257 Aug 05 02:22:13.519543 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 153/306] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:13 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:13.623479 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-75590869-ded2-45d8-ad03-40e88ed11402 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:13.624078 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-75590869-ded2-45d8-ad03-40e88ed11402 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:13.629880 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-75590869-ded2-45d8-ad03-40e88ed11402 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:13.630348 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-75590869-ded2-45d8-ad03-40e88ed11402 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:13.630773 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-75590869-ded2-45d8-ad03-40e88ed11402 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:13.631446 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-75590869-ded2-45d8-ad03-40e88ed11402 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:13.631892 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-75590869-ded2-45d8-ad03-40e88ed11402 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:13.632309 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-75590869-ded2-45d8-ad03-40e88ed11402 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:13.650629 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:13.760266 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-75590869-ded2-45d8-ad03-40e88ed11402 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:13.767618 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-75590869-ded2-45d8-ad03-40e88ed11402 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.148649 Aug 05 02:22:13.768177 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 154/307] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:13 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:14.487000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-868a4d5f-4783-4536-92e8-c82f524601d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:14.487608 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-868a4d5f-4783-4536-92e8-c82f524601d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:14.493977 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-868a4d5f-4783-4536-92e8-c82f524601d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:14.494461 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-868a4d5f-4783-4536-92e8-c82f524601d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:14.494901 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-868a4d5f-4783-4536-92e8-c82f524601d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:14.495639 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-868a4d5f-4783-4536-92e8-c82f524601d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:14.496100 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-868a4d5f-4783-4536-92e8-c82f524601d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:14.496557 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-868a4d5f-4783-4536-92e8-c82f524601d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:14.514511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:14.538870 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-da29c4fd-72e0-4908-b035-bf8510bc2874 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:14.539395 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-da29c4fd-72e0-4908-b035-bf8510bc2874 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:14.545587 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da29c4fd-72e0-4908-b035-bf8510bc2874 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:14.546076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da29c4fd-72e0-4908-b035-bf8510bc2874 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:14.546512 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da29c4fd-72e0-4908-b035-bf8510bc2874 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:14.547205 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da29c4fd-72e0-4908-b035-bf8510bc2874 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:14.547664 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da29c4fd-72e0-4908-b035-bf8510bc2874 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:14.548086 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da29c4fd-72e0-4908-b035-bf8510bc2874 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:14.613205 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-da29c4fd-72e0-4908-b035-bf8510bc2874 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:14.620505 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-da29c4fd-72e0-4908-b035-bf8510bc2874 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1218 microversion: 2.1 time: 0.085398 Aug 05 02:22:14.621081 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 155/308] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:14 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:14.629330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-868a4d5f-4783-4536-92e8-c82f524601d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:14.637264 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-868a4d5f-4783-4536-92e8-c82f524601d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.154077 Aug 05 02:22:14.637826 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 154/309] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:14 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:14.788557 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ec394e7b-0e78-449a-8547-cced42e93ea6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:14.789243 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ec394e7b-0e78-449a-8547-cced42e93ea6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:14.795388 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec394e7b-0e78-449a-8547-cced42e93ea6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:14.795867 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec394e7b-0e78-449a-8547-cced42e93ea6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:14.796296 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec394e7b-0e78-449a-8547-cced42e93ea6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:14.796994 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec394e7b-0e78-449a-8547-cced42e93ea6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:14.797446 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec394e7b-0e78-449a-8547-cced42e93ea6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:14.797861 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec394e7b-0e78-449a-8547-cced42e93ea6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:14.934482 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ec394e7b-0e78-449a-8547-cced42e93ea6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:14.941797 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ec394e7b-0e78-449a-8547-cced42e93ea6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.157330 Aug 05 02:22:14.942353 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 156/310] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:14 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:15.641012 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4b79b23b-cff0-43d8-aa42-784937ade92f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:15.641618 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4b79b23b-cff0-43d8-aa42-784937ade92f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:15.647401 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b79b23b-cff0-43d8-aa42-784937ade92f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:15.647870 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b79b23b-cff0-43d8-aa42-784937ade92f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:15.648300 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b79b23b-cff0-43d8-aa42-784937ade92f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:15.648995 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b79b23b-cff0-43d8-aa42-784937ade92f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:15.649440 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b79b23b-cff0-43d8-aa42-784937ade92f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:15.649856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b79b23b-cff0-43d8-aa42-784937ade92f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:15.658475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-562e77fe-2d1b-4a83-b00c-5d8c706616ca tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:15.659073 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-562e77fe-2d1b-4a83-b00c-5d8c706616ca tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:15.665420 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-562e77fe-2d1b-4a83-b00c-5d8c706616ca tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:15.665902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-562e77fe-2d1b-4a83-b00c-5d8c706616ca tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:15.666328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-562e77fe-2d1b-4a83-b00c-5d8c706616ca tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:15.667010 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-562e77fe-2d1b-4a83-b00c-5d8c706616ca tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:15.668373 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-562e77fe-2d1b-4a83-b00c-5d8c706616ca tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:15.669203 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-562e77fe-2d1b-4a83-b00c-5d8c706616ca tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:15.711810 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4b79b23b-cff0-43d8-aa42-784937ade92f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:15.719697 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4b79b23b-cff0-43d8-aa42-784937ade92f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1218 microversion: 2.1 time: 0.082624 Aug 05 02:22:15.720885 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 155/311] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:15 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:15.799926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-562e77fe-2d1b-4a83-b00c-5d8c706616ca tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:15.807213 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-562e77fe-2d1b-4a83-b00c-5d8c706616ca tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.152721 Aug 05 02:22:15.807809 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 157/312] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:15 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:15.963174 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6727e27d-4635-4dd0-8cea-a5354f8de71b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:15.963775 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6727e27d-4635-4dd0-8cea-a5354f8de71b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:15.982178 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6727e27d-4635-4dd0-8cea-a5354f8de71b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:15.982701 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6727e27d-4635-4dd0-8cea-a5354f8de71b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:15.983137 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6727e27d-4635-4dd0-8cea-a5354f8de71b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:15.983863 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6727e27d-4635-4dd0-8cea-a5354f8de71b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:15.984864 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6727e27d-4635-4dd0-8cea-a5354f8de71b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:15.984864 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6727e27d-4635-4dd0-8cea-a5354f8de71b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:16.274076 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6727e27d-4635-4dd0-8cea-a5354f8de71b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:16.284386 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6727e27d-4635-4dd0-8cea-a5354f8de71b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.325200 Aug 05 02:22:16.285473 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 156/313] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:15 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:16.741163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-989d851c-8deb-440e-ad9b-6d533e420bc9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:16.741767 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-989d851c-8deb-440e-ad9b-6d533e420bc9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:16.743614 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:16.749823 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-989d851c-8deb-440e-ad9b-6d533e420bc9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:16.750362 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-989d851c-8deb-440e-ad9b-6d533e420bc9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:16.750790 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-989d851c-8deb-440e-ad9b-6d533e420bc9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:16.751498 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-989d851c-8deb-440e-ad9b-6d533e420bc9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:16.751945 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-989d851c-8deb-440e-ad9b-6d533e420bc9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:16.752379 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-989d851c-8deb-440e-ad9b-6d533e420bc9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:16.816312 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-989d851c-8deb-440e-ad9b-6d533e420bc9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:16.823604 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-989d851c-8deb-440e-ad9b-6d533e420bc9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1266 microversion: 2.1 time: 0.086262 Aug 05 02:22:16.824250 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 158/314] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:16 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:16.828488 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-70b77cc8-2291-4cfe-8eb6-c5653d0ff19a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:16.829322 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-70b77cc8-2291-4cfe-8eb6-c5653d0ff19a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:16.835755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70b77cc8-2291-4cfe-8eb6-c5653d0ff19a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:16.836247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70b77cc8-2291-4cfe-8eb6-c5653d0ff19a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:16.836718 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70b77cc8-2291-4cfe-8eb6-c5653d0ff19a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:16.837414 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70b77cc8-2291-4cfe-8eb6-c5653d0ff19a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:16.837864 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70b77cc8-2291-4cfe-8eb6-c5653d0ff19a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:16.838286 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70b77cc8-2291-4cfe-8eb6-c5653d0ff19a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:16.969318 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-70b77cc8-2291-4cfe-8eb6-c5653d0ff19a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:16.976951 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-70b77cc8-2291-4cfe-8eb6-c5653d0ff19a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.152355 Aug 05 02:22:16.977502 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 157/315] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:16 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:17.307335 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4c532118-6bef-487b-86a6-22d64733d70b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:17.307887 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4c532118-6bef-487b-86a6-22d64733d70b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:17.313716 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c532118-6bef-487b-86a6-22d64733d70b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:17.314193 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c532118-6bef-487b-86a6-22d64733d70b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:17.314623 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c532118-6bef-487b-86a6-22d64733d70b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:17.315325 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c532118-6bef-487b-86a6-22d64733d70b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:17.315767 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c532118-6bef-487b-86a6-22d64733d70b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:17.316185 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4c532118-6bef-487b-86a6-22d64733d70b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:17.441601 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4c532118-6bef-487b-86a6-22d64733d70b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:17.449190 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4c532118-6bef-487b-86a6-22d64733d70b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.145695 Aug 05 02:22:17.449751 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 159/316] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:17 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:17.546618 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-dfd98f7f-765e-4f0a-b3e1-0b97a05d9589 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:17.547108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dfd98f7f-765e-4f0a-b3e1-0b97a05d9589 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:17.552906 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dfd98f7f-765e-4f0a-b3e1-0b97a05d9589 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:17.553380 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dfd98f7f-765e-4f0a-b3e1-0b97a05d9589 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:17.553808 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dfd98f7f-765e-4f0a-b3e1-0b97a05d9589 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:17.554483 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dfd98f7f-765e-4f0a-b3e1-0b97a05d9589 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:17.555264 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dfd98f7f-765e-4f0a-b3e1-0b97a05d9589 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:17.555690 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dfd98f7f-765e-4f0a-b3e1-0b97a05d9589 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:17.579749 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dfd98f7f-765e-4f0a-b3e1-0b97a05d9589 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:22:17.661458 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-dfd98f7f-765e-4f0a-b3e1-0b97a05d9589 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "DELETE /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 204 len: 0 microversion: 2.1 time: 0.118309 Aug 05 02:22:17.662033 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 158/317] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:22:17 2022] DELETE /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:22:17.670362 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f5e7265e-4504-4868-95a2-4cb9b4171e9a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:17.670994 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f5e7265e-4504-4868-95a2-4cb9b4171e9a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:17.676900 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5e7265e-4504-4868-95a2-4cb9b4171e9a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:17.677380 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5e7265e-4504-4868-95a2-4cb9b4171e9a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:17.677821 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5e7265e-4504-4868-95a2-4cb9b4171e9a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:17.678497 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5e7265e-4504-4868-95a2-4cb9b4171e9a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:17.678949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5e7265e-4504-4868-95a2-4cb9b4171e9a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:17.679371 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5e7265e-4504-4868-95a2-4cb9b4171e9a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:17.806916 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f5e7265e-4504-4868-95a2-4cb9b4171e9a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:17.814870 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f5e7265e-4504-4868-95a2-4cb9b4171e9a tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.148595 Aug 05 02:22:17.815424 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 160/318] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:17 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:17.845923 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a8346f91-914e-4ed1-8a2a-0645b60dce8e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:17.846616 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a8346f91-914e-4ed1-8a2a-0645b60dce8e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:17.853253 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8346f91-914e-4ed1-8a2a-0645b60dce8e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:17.853735 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8346f91-914e-4ed1-8a2a-0645b60dce8e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:17.854171 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8346f91-914e-4ed1-8a2a-0645b60dce8e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:17.854913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8346f91-914e-4ed1-8a2a-0645b60dce8e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:17.855315 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8346f91-914e-4ed1-8a2a-0645b60dce8e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:17.855735 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a8346f91-914e-4ed1-8a2a-0645b60dce8e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:17.915742 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a8346f91-914e-4ed1-8a2a-0645b60dce8e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:17.923070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a8346f91-914e-4ed1-8a2a-0645b60dce8e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1266 microversion: 2.1 time: 0.081888 Aug 05 02:22:17.923636 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 159/319] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:17 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:17.999006 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-70d957b6-4d8c-444c-b00f-a1368684a516 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:17.999607 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-70d957b6-4d8c-444c-b00f-a1368684a516 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:18.005520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70d957b6-4d8c-444c-b00f-a1368684a516 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:18.005990 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70d957b6-4d8c-444c-b00f-a1368684a516 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:18.006417 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70d957b6-4d8c-444c-b00f-a1368684a516 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:18.007093 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70d957b6-4d8c-444c-b00f-a1368684a516 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:18.007544 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70d957b6-4d8c-444c-b00f-a1368684a516 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:18.007964 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-70d957b6-4d8c-444c-b00f-a1368684a516 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:18.139963 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-70d957b6-4d8c-444c-b00f-a1368684a516 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:18.147295 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-70d957b6-4d8c-444c-b00f-a1368684a516 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.152890 Aug 05 02:22:18.147844 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 161/320] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:17 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:18.469594 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d5092281-a8e8-447c-bd52-ef30f0d4b9b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:18.470471 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d5092281-a8e8-447c-bd52-ef30f0d4b9b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:18.476228 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d5092281-a8e8-447c-bd52-ef30f0d4b9b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:18.476753 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d5092281-a8e8-447c-bd52-ef30f0d4b9b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:18.477152 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d5092281-a8e8-447c-bd52-ef30f0d4b9b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:18.477821 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d5092281-a8e8-447c-bd52-ef30f0d4b9b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:18.478262 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d5092281-a8e8-447c-bd52-ef30f0d4b9b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:18.478675 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d5092281-a8e8-447c-bd52-ef30f0d4b9b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:18.607612 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d5092281-a8e8-447c-bd52-ef30f0d4b9b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:18.615246 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d5092281-a8e8-447c-bd52-ef30f0d4b9b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.149379 Aug 05 02:22:18.615820 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 160/321] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:18 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:18.835868 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-03fb0a11-404f-4bc1-9629-027dfe4c45fb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:18.836534 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-03fb0a11-404f-4bc1-9629-027dfe4c45fb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:18.843532 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03fb0a11-404f-4bc1-9629-027dfe4c45fb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:18.844019 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03fb0a11-404f-4bc1-9629-027dfe4c45fb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:18.844492 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03fb0a11-404f-4bc1-9629-027dfe4c45fb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:18.845434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03fb0a11-404f-4bc1-9629-027dfe4c45fb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:18.845881 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03fb0a11-404f-4bc1-9629-027dfe4c45fb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:18.846298 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03fb0a11-404f-4bc1-9629-027dfe4c45fb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:18.943356 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5eea1de7-86a0-4397-abc7-bf2c0fce1242 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:18.944486 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5eea1de7-86a0-4397-abc7-bf2c0fce1242 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:18.951125 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5eea1de7-86a0-4397-abc7-bf2c0fce1242 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:18.951607 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5eea1de7-86a0-4397-abc7-bf2c0fce1242 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:18.952042 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5eea1de7-86a0-4397-abc7-bf2c0fce1242 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:18.952762 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5eea1de7-86a0-4397-abc7-bf2c0fce1242 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:18.953219 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5eea1de7-86a0-4397-abc7-bf2c0fce1242 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:18.953641 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5eea1de7-86a0-4397-abc7-bf2c0fce1242 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:18.975609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-03fb0a11-404f-4bc1-9629-027dfe4c45fb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:18.976108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:18.984075 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-03fb0a11-404f-4bc1-9629-027dfe4c45fb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.152047 Aug 05 02:22:18.984682 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 162/322] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:18 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:18.993547 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:19.020343 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5eea1de7-86a0-4397-abc7-bf2c0fce1242 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:19.028220 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5eea1de7-86a0-4397-abc7-bf2c0fce1242 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1266 microversion: 2.1 time: 0.088756 Aug 05 02:22:19.028820 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 161/323] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:18 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:19.168612 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b11e7218-ae3a-44a1-9d18-244101e28efd tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:19.169223 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b11e7218-ae3a-44a1-9d18-244101e28efd tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:19.171096 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:19.176204 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11e7218-ae3a-44a1-9d18-244101e28efd tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:19.176705 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11e7218-ae3a-44a1-9d18-244101e28efd tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:19.177156 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11e7218-ae3a-44a1-9d18-244101e28efd tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:19.177836 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11e7218-ae3a-44a1-9d18-244101e28efd tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:19.178282 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11e7218-ae3a-44a1-9d18-244101e28efd tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:19.178705 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11e7218-ae3a-44a1-9d18-244101e28efd tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:19.308768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b11e7218-ae3a-44a1-9d18-244101e28efd tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:19.316049 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b11e7218-ae3a-44a1-9d18-244101e28efd tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.151895 Aug 05 02:22:19.316642 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 163/324] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:19 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:19.637371 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ea68a2b2-c120-460b-887c-b6bf880c11c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:19.637966 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ea68a2b2-c120-460b-887c-b6bf880c11c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:19.643772 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea68a2b2-c120-460b-887c-b6bf880c11c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:19.644241 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea68a2b2-c120-460b-887c-b6bf880c11c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:19.644698 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea68a2b2-c120-460b-887c-b6bf880c11c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:19.645367 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea68a2b2-c120-460b-887c-b6bf880c11c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:19.645811 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea68a2b2-c120-460b-887c-b6bf880c11c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:19.646225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea68a2b2-c120-460b-887c-b6bf880c11c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:19.774592 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ea68a2b2-c120-460b-887c-b6bf880c11c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:19.782017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ea68a2b2-c120-460b-887c-b6bf880c11c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.149171 Aug 05 02:22:19.782585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 162/325] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:19 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:20.004047 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d624f8e7-c24b-4f70-9ede-313180bf33f2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:20.004683 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d624f8e7-c24b-4f70-9ede-313180bf33f2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:20.010637 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d624f8e7-c24b-4f70-9ede-313180bf33f2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:20.011179 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d624f8e7-c24b-4f70-9ede-313180bf33f2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:20.011613 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d624f8e7-c24b-4f70-9ede-313180bf33f2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:20.012289 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d624f8e7-c24b-4f70-9ede-313180bf33f2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:20.012768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d624f8e7-c24b-4f70-9ede-313180bf33f2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:20.013187 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d624f8e7-c24b-4f70-9ede-313180bf33f2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:20.048687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f6a335e9-0691-4f9e-8295-548760beac42 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:20.049288 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f6a335e9-0691-4f9e-8295-548760beac42 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:20.055749 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6a335e9-0691-4f9e-8295-548760beac42 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:20.056223 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6a335e9-0691-4f9e-8295-548760beac42 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:20.056687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6a335e9-0691-4f9e-8295-548760beac42 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:20.057377 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6a335e9-0691-4f9e-8295-548760beac42 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:20.059124 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6a335e9-0691-4f9e-8295-548760beac42 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:20.059265 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6a335e9-0691-4f9e-8295-548760beac42 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:20.125369 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f6a335e9-0691-4f9e-8295-548760beac42 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:20.132616 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f6a335e9-0691-4f9e-8295-548760beac42 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1266 microversion: 2.1 time: 0.087635 Aug 05 02:22:20.133170 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 163/326] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:20 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:20.142605 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d624f8e7-c24b-4f70-9ede-313180bf33f2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:20.150517 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d624f8e7-c24b-4f70-9ede-313180bf33f2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.150263 Aug 05 02:22:20.151064 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 164/327] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:19 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:20.337029 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8df16238-64df-41cc-a575-054ea54d3b99 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:20.337550 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8df16238-64df-41cc-a575-054ea54d3b99 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:20.343777 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8df16238-64df-41cc-a575-054ea54d3b99 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:20.344286 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8df16238-64df-41cc-a575-054ea54d3b99 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:20.344751 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8df16238-64df-41cc-a575-054ea54d3b99 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:20.345684 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8df16238-64df-41cc-a575-054ea54d3b99 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:20.346127 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8df16238-64df-41cc-a575-054ea54d3b99 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:20.346541 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8df16238-64df-41cc-a575-054ea54d3b99 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:20.474780 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8df16238-64df-41cc-a575-054ea54d3b99 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:20.482709 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8df16238-64df-41cc-a575-054ea54d3b99 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.149566 Aug 05 02:22:20.483261 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 164/328] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:20 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:20.802566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b11a1509-834b-4064-809c-6d13fa0842b2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:20.803177 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b11a1509-834b-4064-809c-6d13fa0842b2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:20.809104 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11a1509-834b-4064-809c-6d13fa0842b2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:20.809588 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11a1509-834b-4064-809c-6d13fa0842b2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:20.810027 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11a1509-834b-4064-809c-6d13fa0842b2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:20.810713 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11a1509-834b-4064-809c-6d13fa0842b2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:20.811166 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11a1509-834b-4064-809c-6d13fa0842b2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:20.811592 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b11a1509-834b-4064-809c-6d13fa0842b2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:20.938523 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b11a1509-834b-4064-809c-6d13fa0842b2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:20.945834 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b11a1509-834b-4064-809c-6d13fa0842b2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.147085 Aug 05 02:22:20.946391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 165/329] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:20 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:21.153455 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f2c977e9-25b2-4f78-8835-dbe673b53964 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:21.154020 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f2c977e9-25b2-4f78-8835-dbe673b53964 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:21.162121 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f2c977e9-25b2-4f78-8835-dbe673b53964 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:21.162596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f2c977e9-25b2-4f78-8835-dbe673b53964 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:21.163019 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f2c977e9-25b2-4f78-8835-dbe673b53964 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:21.163699 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f2c977e9-25b2-4f78-8835-dbe673b53964 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:21.164143 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f2c977e9-25b2-4f78-8835-dbe673b53964 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:21.164582 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f2c977e9-25b2-4f78-8835-dbe673b53964 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:21.171207 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d5c0dd76-bcd2-4483-ba9f-9c5adcc6b765 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:21.171809 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d5c0dd76-bcd2-4483-ba9f-9c5adcc6b765 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:21.177629 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5c0dd76-bcd2-4483-ba9f-9c5adcc6b765 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:21.178136 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5c0dd76-bcd2-4483-ba9f-9c5adcc6b765 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:21.178561 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5c0dd76-bcd2-4483-ba9f-9c5adcc6b765 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:21.179243 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5c0dd76-bcd2-4483-ba9f-9c5adcc6b765 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:21.179691 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5c0dd76-bcd2-4483-ba9f-9c5adcc6b765 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:21.180105 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5c0dd76-bcd2-4483-ba9f-9c5adcc6b765 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:21.241552 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f2c977e9-25b2-4f78-8835-dbe673b53964 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:21.250664 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f2c977e9-25b2-4f78-8835-dbe673b53964 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1274 microversion: 2.1 time: 0.101238 Aug 05 02:22:21.251231 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 165/330] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:21 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1274 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:21.330888 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d5c0dd76-bcd2-4483-ba9f-9c5adcc6b765 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:21.338894 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d5c0dd76-bcd2-4483-ba9f-9c5adcc6b765 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.171505 Aug 05 02:22:21.339810 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 166/331] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:21 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:21.502802 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3767a5ea-42c2-4149-8457-dc9be34d87c3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:21.503411 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3767a5ea-42c2-4149-8457-dc9be34d87c3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:21.509281 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3767a5ea-42c2-4149-8457-dc9be34d87c3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:21.509763 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3767a5ea-42c2-4149-8457-dc9be34d87c3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:21.510198 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3767a5ea-42c2-4149-8457-dc9be34d87c3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:21.510960 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3767a5ea-42c2-4149-8457-dc9be34d87c3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:21.511444 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3767a5ea-42c2-4149-8457-dc9be34d87c3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:21.511872 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3767a5ea-42c2-4149-8457-dc9be34d87c3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:21.639398 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3767a5ea-42c2-4149-8457-dc9be34d87c3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:21.646784 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3767a5ea-42c2-4149-8457-dc9be34d87c3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.147820 Aug 05 02:22:21.647352 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 166/332] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:21 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:21.967044 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dec5591d-809d-42bb-9932-6472ff921a95 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:21.967641 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dec5591d-809d-42bb-9932-6472ff921a95 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:21.973779 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dec5591d-809d-42bb-9932-6472ff921a95 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:21.974256 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dec5591d-809d-42bb-9932-6472ff921a95 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:21.974691 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dec5591d-809d-42bb-9932-6472ff921a95 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:21.975390 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dec5591d-809d-42bb-9932-6472ff921a95 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:21.975841 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dec5591d-809d-42bb-9932-6472ff921a95 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:21.976256 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dec5591d-809d-42bb-9932-6472ff921a95 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:22.101681 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dec5591d-809d-42bb-9932-6472ff921a95 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:22.109552 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dec5591d-809d-42bb-9932-6472ff921a95 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.146953 Aug 05 02:22:22.110110 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 167/333] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:21 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:22.272041 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3f913d8d-a959-4aa2-b0a1-d3fd51e61318 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:22.272677 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3f913d8d-a959-4aa2-b0a1-d3fd51e61318 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:22.280161 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3f913d8d-a959-4aa2-b0a1-d3fd51e61318 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:22.280668 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3f913d8d-a959-4aa2-b0a1-d3fd51e61318 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:22.281100 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3f913d8d-a959-4aa2-b0a1-d3fd51e61318 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:22.281778 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3f913d8d-a959-4aa2-b0a1-d3fd51e61318 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:22.282225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3f913d8d-a959-4aa2-b0a1-d3fd51e61318 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:22.282641 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3f913d8d-a959-4aa2-b0a1-d3fd51e61318 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:22.343864 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3f913d8d-a959-4aa2-b0a1-d3fd51e61318 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:22.351594 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3f913d8d-a959-4aa2-b0a1-d3fd51e61318 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1284 microversion: 2.1 time: 0.083272 Aug 05 02:22:22.352089 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 167/334] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:22 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1284 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:22.362021 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3ffa6ae1-0e3e-4095-a9a4-4b3b1a2d5fb9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:22.363494 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3ffa6ae1-0e3e-4095-a9a4-4b3b1a2d5fb9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:22.369328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ffa6ae1-0e3e-4095-a9a4-4b3b1a2d5fb9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:22.369813 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ffa6ae1-0e3e-4095-a9a4-4b3b1a2d5fb9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:22.371457 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ffa6ae1-0e3e-4095-a9a4-4b3b1a2d5fb9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:22.372159 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ffa6ae1-0e3e-4095-a9a4-4b3b1a2d5fb9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:22.372636 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ffa6ae1-0e3e-4095-a9a4-4b3b1a2d5fb9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:22.373058 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ffa6ae1-0e3e-4095-a9a4-4b3b1a2d5fb9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:22.502959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3ffa6ae1-0e3e-4095-a9a4-4b3b1a2d5fb9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:22.511414 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3ffa6ae1-0e3e-4095-a9a4-4b3b1a2d5fb9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.153230 Aug 05 02:22:22.511975 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 168/335] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:22 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:22.669854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-810a7b9b-6069-4e66-9f03-0a1eb8db1f0a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:22.670643 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-810a7b9b-6069-4e66-9f03-0a1eb8db1f0a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:22.676751 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-810a7b9b-6069-4e66-9f03-0a1eb8db1f0a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:22.677234 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-810a7b9b-6069-4e66-9f03-0a1eb8db1f0a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:22.677665 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-810a7b9b-6069-4e66-9f03-0a1eb8db1f0a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:22.678355 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-810a7b9b-6069-4e66-9f03-0a1eb8db1f0a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:22.678804 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-810a7b9b-6069-4e66-9f03-0a1eb8db1f0a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:22.679227 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-810a7b9b-6069-4e66-9f03-0a1eb8db1f0a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:23.062348 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-810a7b9b-6069-4e66-9f03-0a1eb8db1f0a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:23.069695 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-810a7b9b-6069-4e66-9f03-0a1eb8db1f0a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.405693 Aug 05 02:22:23.070256 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 168/336] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:22 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:23.130043 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-52173e4e-af2a-4d3f-8ea1-f479a1ced786 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:23.130641 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-52173e4e-af2a-4d3f-8ea1-f479a1ced786 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:23.137060 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52173e4e-af2a-4d3f-8ea1-f479a1ced786 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:23.137196 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52173e4e-af2a-4d3f-8ea1-f479a1ced786 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:23.137593 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52173e4e-af2a-4d3f-8ea1-f479a1ced786 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:23.138295 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52173e4e-af2a-4d3f-8ea1-f479a1ced786 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:23.138745 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52173e4e-af2a-4d3f-8ea1-f479a1ced786 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:23.139913 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52173e4e-af2a-4d3f-8ea1-f479a1ced786 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:23.268959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-52173e4e-af2a-4d3f-8ea1-f479a1ced786 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:23.276816 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-52173e4e-af2a-4d3f-8ea1-f479a1ced786 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.150475 Aug 05 02:22:23.277382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 169/337] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:23 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:23.373160 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2ae66a68-4ea4-4d22-87b9-c1e20638c425 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:23.373842 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2ae66a68-4ea4-4d22-87b9-c1e20638c425 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:23.381114 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ae66a68-4ea4-4d22-87b9-c1e20638c425 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:23.381700 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ae66a68-4ea4-4d22-87b9-c1e20638c425 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:23.382248 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ae66a68-4ea4-4d22-87b9-c1e20638c425 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:23.383014 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ae66a68-4ea4-4d22-87b9-c1e20638c425 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:23.383536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ae66a68-4ea4-4d22-87b9-c1e20638c425 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:23.384030 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ae66a68-4ea4-4d22-87b9-c1e20638c425 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:23.402070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:23.456150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2ae66a68-4ea4-4d22-87b9-c1e20638c425 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:23.464725 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2ae66a68-4ea4-4d22-87b9-c1e20638c425 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1272 microversion: 2.1 time: 0.095680 Aug 05 02:22:23.465579 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 169/338] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:23 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:23.533071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-10371d27-7f97-423b-a8ee-2758a90000ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:23.539336 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-10371d27-7f97-423b-a8ee-2758a90000ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:23.550060 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-10371d27-7f97-423b-a8ee-2758a90000ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:23.550679 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-10371d27-7f97-423b-a8ee-2758a90000ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:23.551182 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-10371d27-7f97-423b-a8ee-2758a90000ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:23.551885 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-10371d27-7f97-423b-a8ee-2758a90000ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:23.552368 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-10371d27-7f97-423b-a8ee-2758a90000ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:23.552817 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-10371d27-7f97-423b-a8ee-2758a90000ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:23.693534 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-10371d27-7f97-423b-a8ee-2758a90000ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:23.713917 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-10371d27-7f97-423b-a8ee-2758a90000ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.175200 Aug 05 02:22:23.715153 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 170/339] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:23 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:24.091969 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f963b7eb-9112-47eb-804f-3bea0c0e1f68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:24.092552 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f963b7eb-9112-47eb-804f-3bea0c0e1f68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:24.098628 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f963b7eb-9112-47eb-804f-3bea0c0e1f68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:24.099099 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f963b7eb-9112-47eb-804f-3bea0c0e1f68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:24.099527 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f963b7eb-9112-47eb-804f-3bea0c0e1f68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:24.100202 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f963b7eb-9112-47eb-804f-3bea0c0e1f68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:24.100672 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f963b7eb-9112-47eb-804f-3bea0c0e1f68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:24.101086 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f963b7eb-9112-47eb-804f-3bea0c0e1f68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:24.297608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-42a55a33-17fc-4a1c-ab73-70ff9e0955b0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:24.298214 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-42a55a33-17fc-4a1c-ab73-70ff9e0955b0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:24.303948 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42a55a33-17fc-4a1c-ab73-70ff9e0955b0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:24.304457 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42a55a33-17fc-4a1c-ab73-70ff9e0955b0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:24.304890 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42a55a33-17fc-4a1c-ab73-70ff9e0955b0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:24.305568 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42a55a33-17fc-4a1c-ab73-70ff9e0955b0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:24.306015 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42a55a33-17fc-4a1c-ab73-70ff9e0955b0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:24.306430 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42a55a33-17fc-4a1c-ab73-70ff9e0955b0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:24.310865 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:24.322558 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f963b7eb-9112-47eb-804f-3bea0c0e1f68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:24.330672 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f963b7eb-9112-47eb-804f-3bea0c0e1f68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.243933 Aug 05 02:22:24.331331 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 170/340] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:24 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:24.439465 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-42a55a33-17fc-4a1c-ab73-70ff9e0955b0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:24.446938 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-42a55a33-17fc-4a1c-ab73-70ff9e0955b0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.153289 Aug 05 02:22:24.447498 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 171/341] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:24 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:24.486147 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a04c6628-b233-419b-8f74-9061a3e1a2ff tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:24.486758 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a04c6628-b233-419b-8f74-9061a3e1a2ff tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:24.493002 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a04c6628-b233-419b-8f74-9061a3e1a2ff tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:24.493484 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a04c6628-b233-419b-8f74-9061a3e1a2ff tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:24.493919 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a04c6628-b233-419b-8f74-9061a3e1a2ff tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:24.494615 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a04c6628-b233-419b-8f74-9061a3e1a2ff tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:24.495589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a04c6628-b233-419b-8f74-9061a3e1a2ff tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:24.496007 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a04c6628-b233-419b-8f74-9061a3e1a2ff tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:24.724577 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a04c6628-b233-419b-8f74-9061a3e1a2ff tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:24.733098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a04c6628-b233-419b-8f74-9061a3e1a2ff tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.250526 Aug 05 02:22:24.733665 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 171/342] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:24 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:24.747449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f54fe9ff-50b0-4f4d-9424-e820e0c5e5ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:24.747995 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f54fe9ff-50b0-4f4d-9424-e820e0c5e5ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:24.754340 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f54fe9ff-50b0-4f4d-9424-e820e0c5e5ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:24.754819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f54fe9ff-50b0-4f4d-9424-e820e0c5e5ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:24.755249 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f54fe9ff-50b0-4f4d-9424-e820e0c5e5ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:24.755944 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f54fe9ff-50b0-4f4d-9424-e820e0c5e5ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:24.756418 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f54fe9ff-50b0-4f4d-9424-e820e0c5e5ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:24.756844 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f54fe9ff-50b0-4f4d-9424-e820e0c5e5ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:24.895090 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f54fe9ff-50b0-4f4d-9424-e820e0c5e5ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:24.904351 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f54fe9ff-50b0-4f4d-9424-e820e0c5e5ae tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.172678 Aug 05 02:22:24.905109 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 172/343] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:24 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:24.939589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-90991976-d81f-4309-90e9-63a0c2e46a87 req-445c66e1-6411-4787-9f5d-080404c4601c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9953aa28-10c7-463e-b2f2-9640f42f9eb0", "tag": "dfd12349-70f1-45d4-b28a-ecee9fcd63ab"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:22:24.950257 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-90991976-d81f-4309-90e9-63a0c2e46a87 req-445c66e1-6411-4787-9f5d-080404c4601c service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:24.950732 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-90991976-d81f-4309-90e9-63a0c2e46a87 req-445c66e1-6411-4787-9f5d-080404c4601c service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:24.951155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-90991976-d81f-4309-90e9-63a0c2e46a87 req-445c66e1-6411-4787-9f5d-080404c4601c service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:24.962040 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-90991976-d81f-4309-90e9-63a0c2e46a87 req-445c66e1-6411-4787-9f5d-080404c4601c service nova] Creating event network-changed:dfd12349-70f1-45d4-b28a-ecee9fcd63ab for instance 9953aa28-10c7-463e-b2f2-9640f42f9eb0 on hv-cinder-81558 Aug 05 02:22:24.968418 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-90991976-d81f-4309-90e9-63a0c2e46a87 req-445c66e1-6411-4787-9f5d-080404c4601c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032512 Aug 05 02:22:24.969007 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 172/344] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:22:25.351309 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-88b7c1f9-d85d-4ac3-b495-a864bf633f54 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:25.351846 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-88b7c1f9-d85d-4ac3-b495-a864bf633f54 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:25.357926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88b7c1f9-d85d-4ac3-b495-a864bf633f54 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:25.358411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88b7c1f9-d85d-4ac3-b495-a864bf633f54 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:25.358845 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88b7c1f9-d85d-4ac3-b495-a864bf633f54 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:25.359527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88b7c1f9-d85d-4ac3-b495-a864bf633f54 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:25.359982 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88b7c1f9-d85d-4ac3-b495-a864bf633f54 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:25.360439 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88b7c1f9-d85d-4ac3-b495-a864bf633f54 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:25.469951 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-20c1af4b-74b7-460d-8662-d8506aa6d320 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:25.470676 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-20c1af4b-74b7-460d-8662-d8506aa6d320 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:25.476697 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20c1af4b-74b7-460d-8662-d8506aa6d320 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:25.477178 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20c1af4b-74b7-460d-8662-d8506aa6d320 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:25.477608 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20c1af4b-74b7-460d-8662-d8506aa6d320 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:25.478292 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20c1af4b-74b7-460d-8662-d8506aa6d320 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:25.478737 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20c1af4b-74b7-460d-8662-d8506aa6d320 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:25.479694 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20c1af4b-74b7-460d-8662-d8506aa6d320 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:25.489965 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-88b7c1f9-d85d-4ac3-b495-a864bf633f54 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:25.498258 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-88b7c1f9-d85d-4ac3-b495-a864bf633f54 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.150861 Aug 05 02:22:25.498824 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 173/345] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:25 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:25.610776 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-20c1af4b-74b7-460d-8662-d8506aa6d320 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:25.618133 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-20c1af4b-74b7-460d-8662-d8506aa6d320 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.152595 Aug 05 02:22:25.618686 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 173/346] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:25 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:25.755030 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e3144dcc-9fab-43dc-acc1-933f4eb5913b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:25.755631 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e3144dcc-9fab-43dc-acc1-933f4eb5913b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:25.761591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3144dcc-9fab-43dc-acc1-933f4eb5913b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:25.762066 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3144dcc-9fab-43dc-acc1-933f4eb5913b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:25.762496 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3144dcc-9fab-43dc-acc1-933f4eb5913b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:25.763172 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3144dcc-9fab-43dc-acc1-933f4eb5913b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:25.763620 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3144dcc-9fab-43dc-acc1-933f4eb5913b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:25.764057 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e3144dcc-9fab-43dc-acc1-933f4eb5913b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:25.893787 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e3144dcc-9fab-43dc-acc1-933f4eb5913b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:25.902396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e3144dcc-9fab-43dc-acc1-933f4eb5913b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.150112 Aug 05 02:22:25.902958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 174/347] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:25 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:25.925385 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cabb0177-b8c8-4922-ae9c-a748da5668b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:25.925991 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cabb0177-b8c8-4922-ae9c-a748da5668b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:25.931887 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cabb0177-b8c8-4922-ae9c-a748da5668b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:25.933458 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cabb0177-b8c8-4922-ae9c-a748da5668b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:25.933911 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cabb0177-b8c8-4922-ae9c-a748da5668b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:25.934601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cabb0177-b8c8-4922-ae9c-a748da5668b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:25.935055 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cabb0177-b8c8-4922-ae9c-a748da5668b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:25.935478 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cabb0177-b8c8-4922-ae9c-a748da5668b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:26.090384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cabb0177-b8c8-4922-ae9c-a748da5668b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:26.098360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cabb0177-b8c8-4922-ae9c-a748da5668b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.176751 Aug 05 02:22:26.098914 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 174/348] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:25 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:26.519164 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-47a91dd9-f001-43dd-988c-2b7db4aeb822 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:26.519773 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-47a91dd9-f001-43dd-988c-2b7db4aeb822 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:26.525690 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47a91dd9-f001-43dd-988c-2b7db4aeb822 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:26.526748 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47a91dd9-f001-43dd-988c-2b7db4aeb822 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:26.527182 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47a91dd9-f001-43dd-988c-2b7db4aeb822 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:26.527872 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47a91dd9-f001-43dd-988c-2b7db4aeb822 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:26.528342 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47a91dd9-f001-43dd-988c-2b7db4aeb822 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:26.528768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47a91dd9-f001-43dd-988c-2b7db4aeb822 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:26.639581 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-be088497-1603-4ab2-9fbe-3c484247524a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:26.640192 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-be088497-1603-4ab2-9fbe-3c484247524a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:26.646550 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be088497-1603-4ab2-9fbe-3c484247524a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:26.647035 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be088497-1603-4ab2-9fbe-3c484247524a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:26.647497 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be088497-1603-4ab2-9fbe-3c484247524a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:26.648195 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be088497-1603-4ab2-9fbe-3c484247524a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:26.648674 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be088497-1603-4ab2-9fbe-3c484247524a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:26.649095 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be088497-1603-4ab2-9fbe-3c484247524a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:26.658710 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-47a91dd9-f001-43dd-988c-2b7db4aeb822 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:26.666039 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-47a91dd9-f001-43dd-988c-2b7db4aeb822 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.150983 Aug 05 02:22:26.666603 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 175/349] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:26 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:26.781068 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-be088497-1603-4ab2-9fbe-3c484247524a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:26.788289 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-be088497-1603-4ab2-9fbe-3c484247524a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.153180 Aug 05 02:22:26.788873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 175/350] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:26 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:26.922559 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2baaaa43-c8b5-457d-a5f5-d9c2cbf0dbe0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:26.923450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2baaaa43-c8b5-457d-a5f5-d9c2cbf0dbe0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:26.929533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2baaaa43-c8b5-457d-a5f5-d9c2cbf0dbe0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:26.930013 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2baaaa43-c8b5-457d-a5f5-d9c2cbf0dbe0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:26.930439 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2baaaa43-c8b5-457d-a5f5-d9c2cbf0dbe0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:26.931117 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2baaaa43-c8b5-457d-a5f5-d9c2cbf0dbe0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:26.931561 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2baaaa43-c8b5-457d-a5f5-d9c2cbf0dbe0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:26.931975 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2baaaa43-c8b5-457d-a5f5-d9c2cbf0dbe0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:27.061691 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2baaaa43-c8b5-457d-a5f5-d9c2cbf0dbe0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:27.069143 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2baaaa43-c8b5-457d-a5f5-d9c2cbf0dbe0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.150463 Aug 05 02:22:27.069727 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 176/351] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:26 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:27.119027 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-edce9e73-50a5-4534-8498-2ef84c6dfdfe tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:27.119618 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-edce9e73-50a5-4534-8498-2ef84c6dfdfe tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:27.126064 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-edce9e73-50a5-4534-8498-2ef84c6dfdfe tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:27.126534 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-edce9e73-50a5-4534-8498-2ef84c6dfdfe tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:27.126965 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-edce9e73-50a5-4534-8498-2ef84c6dfdfe tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:27.127635 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-edce9e73-50a5-4534-8498-2ef84c6dfdfe tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:27.128078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-edce9e73-50a5-4534-8498-2ef84c6dfdfe tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:27.128530 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-edce9e73-50a5-4534-8498-2ef84c6dfdfe tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:27.252870 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-edce9e73-50a5-4534-8498-2ef84c6dfdfe tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:27.260772 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-edce9e73-50a5-4534-8498-2ef84c6dfdfe tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.145343 Aug 05 02:22:27.261332 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 176/352] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:27 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:27.687251 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c045c689-5c2d-4f03-82cc-793d97f97387 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:27.687858 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c045c689-5c2d-4f03-82cc-793d97f97387 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:27.693914 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c045c689-5c2d-4f03-82cc-793d97f97387 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:27.694396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c045c689-5c2d-4f03-82cc-793d97f97387 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:27.694833 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c045c689-5c2d-4f03-82cc-793d97f97387 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:27.695516 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c045c689-5c2d-4f03-82cc-793d97f97387 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:27.695971 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c045c689-5c2d-4f03-82cc-793d97f97387 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:27.696421 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c045c689-5c2d-4f03-82cc-793d97f97387 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:27.809127 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a3dbeb8c-8418-4e71-b680-9f5b5ff905c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:27.809841 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a3dbeb8c-8418-4e71-b680-9f5b5ff905c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:27.816209 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3dbeb8c-8418-4e71-b680-9f5b5ff905c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:27.816792 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3dbeb8c-8418-4e71-b680-9f5b5ff905c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:27.817295 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3dbeb8c-8418-4e71-b680-9f5b5ff905c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:27.817990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3dbeb8c-8418-4e71-b680-9f5b5ff905c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:27.818451 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3dbeb8c-8418-4e71-b680-9f5b5ff905c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:27.818874 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3dbeb8c-8418-4e71-b680-9f5b5ff905c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:27.822728 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c045c689-5c2d-4f03-82cc-793d97f97387 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:27.830860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c045c689-5c2d-4f03-82cc-793d97f97387 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.147504 Aug 05 02:22:27.831641 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 177/353] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:27 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:27.952887 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a3dbeb8c-8418-4e71-b680-9f5b5ff905c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:27.960221 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a3dbeb8c-8418-4e71-b680-9f5b5ff905c4 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.154985 Aug 05 02:22:27.960803 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 177/354] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:27 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:28.090056 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5191e450-0569-453c-a394-a8adc880ec72 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:28.090667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5191e450-0569-453c-a394-a8adc880ec72 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:28.096779 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5191e450-0569-453c-a394-a8adc880ec72 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:28.097254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5191e450-0569-453c-a394-a8adc880ec72 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:28.097682 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5191e450-0569-453c-a394-a8adc880ec72 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:28.098354 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5191e450-0569-453c-a394-a8adc880ec72 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:28.098799 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5191e450-0569-453c-a394-a8adc880ec72 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:28.099215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5191e450-0569-453c-a394-a8adc880ec72 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:28.229247 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5191e450-0569-453c-a394-a8adc880ec72 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:28.236675 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5191e450-0569-453c-a394-a8adc880ec72 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.150759 Aug 05 02:22:28.237235 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 178/355] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:28 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:28.281041 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f9c13735-676c-4d84-91ce-682adad53b0e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:28.281647 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f9c13735-676c-4d84-91ce-682adad53b0e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:28.287519 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9c13735-676c-4d84-91ce-682adad53b0e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:28.287993 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9c13735-676c-4d84-91ce-682adad53b0e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:28.288464 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9c13735-676c-4d84-91ce-682adad53b0e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:28.289143 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9c13735-676c-4d84-91ce-682adad53b0e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:28.289591 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9c13735-676c-4d84-91ce-682adad53b0e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:28.290010 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f9c13735-676c-4d84-91ce-682adad53b0e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:28.419963 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f9c13735-676c-4d84-91ce-682adad53b0e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:28.427867 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f9c13735-676c-4d84-91ce-682adad53b0e tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.150515 Aug 05 02:22:28.428390 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 178/356] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:28 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:28.851841 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6ebad688-4146-4fd2-973b-5f24b074201d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:28.852480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6ebad688-4146-4fd2-973b-5f24b074201d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:28.858411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ebad688-4146-4fd2-973b-5f24b074201d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:28.858892 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ebad688-4146-4fd2-973b-5f24b074201d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:28.859326 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ebad688-4146-4fd2-973b-5f24b074201d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:28.860002 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ebad688-4146-4fd2-973b-5f24b074201d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:28.860488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ebad688-4146-4fd2-973b-5f24b074201d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:28.860910 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ebad688-4146-4fd2-973b-5f24b074201d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:28.982445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6b4e8ea5-6948-46e5-a77b-700214bde16f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:28.983047 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6b4e8ea5-6948-46e5-a77b-700214bde16f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:28.987746 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6ebad688-4146-4fd2-973b-5f24b074201d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:28.989466 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b4e8ea5-6948-46e5-a77b-700214bde16f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:28.989948 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b4e8ea5-6948-46e5-a77b-700214bde16f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:28.990372 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b4e8ea5-6948-46e5-a77b-700214bde16f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:28.991061 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b4e8ea5-6948-46e5-a77b-700214bde16f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:28.991503 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b4e8ea5-6948-46e5-a77b-700214bde16f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:28.991915 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b4e8ea5-6948-46e5-a77b-700214bde16f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:28.995700 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6ebad688-4146-4fd2-973b-5f24b074201d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.147672 Aug 05 02:22:28.996504 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 179/357] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:28 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:29.125366 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6b4e8ea5-6948-46e5-a77b-700214bde16f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:29.132662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6b4e8ea5-6948-46e5-a77b-700214bde16f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.153994 Aug 05 02:22:29.133223 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 179/358] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:28 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:29.257500 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-30785a9b-a75a-4cf9-8584-55eb01c38cdf tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:29.258103 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-30785a9b-a75a-4cf9-8584-55eb01c38cdf tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:29.264201 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30785a9b-a75a-4cf9-8584-55eb01c38cdf tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:29.264708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30785a9b-a75a-4cf9-8584-55eb01c38cdf tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:29.265137 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30785a9b-a75a-4cf9-8584-55eb01c38cdf tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:29.265814 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30785a9b-a75a-4cf9-8584-55eb01c38cdf tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:29.266258 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30785a9b-a75a-4cf9-8584-55eb01c38cdf tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:29.266671 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30785a9b-a75a-4cf9-8584-55eb01c38cdf tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:29.395801 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-30785a9b-a75a-4cf9-8584-55eb01c38cdf tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:29.403595 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-30785a9b-a75a-4cf9-8584-55eb01c38cdf tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.149788 Aug 05 02:22:29.404145 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 180/359] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:29 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:29.448474 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bbe6d865-19b7-4f10-a213-2ce39ea8ebd6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:29.449080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bbe6d865-19b7-4f10-a213-2ce39ea8ebd6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:29.455092 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bbe6d865-19b7-4f10-a213-2ce39ea8ebd6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:29.455591 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bbe6d865-19b7-4f10-a213-2ce39ea8ebd6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:29.456020 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bbe6d865-19b7-4f10-a213-2ce39ea8ebd6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:29.456761 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bbe6d865-19b7-4f10-a213-2ce39ea8ebd6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:29.457208 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bbe6d865-19b7-4f10-a213-2ce39ea8ebd6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:29.457649 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bbe6d865-19b7-4f10-a213-2ce39ea8ebd6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:29.585892 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bbe6d865-19b7-4f10-a213-2ce39ea8ebd6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:29.594235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bbe6d865-19b7-4f10-a213-2ce39ea8ebd6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.149727 Aug 05 02:22:29.594975 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 180/360] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:29 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:30.016942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-873e8597-9408-4e84-bb35-80a7c8db2069 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:30.017558 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-873e8597-9408-4e84-bb35-80a7c8db2069 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:30.023496 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-873e8597-9408-4e84-bb35-80a7c8db2069 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:30.023973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-873e8597-9408-4e84-bb35-80a7c8db2069 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:30.024434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-873e8597-9408-4e84-bb35-80a7c8db2069 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:30.025121 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-873e8597-9408-4e84-bb35-80a7c8db2069 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:30.025574 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-873e8597-9408-4e84-bb35-80a7c8db2069 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:30.027282 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-873e8597-9408-4e84-bb35-80a7c8db2069 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:30.153914 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bba82851-1ddb-4bf6-9787-5243b12ac4ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:30.154516 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bba82851-1ddb-4bf6-9787-5243b12ac4ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:30.160861 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bba82851-1ddb-4bf6-9787-5243b12ac4ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:30.161342 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bba82851-1ddb-4bf6-9787-5243b12ac4ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:30.161768 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bba82851-1ddb-4bf6-9787-5243b12ac4ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:30.162453 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bba82851-1ddb-4bf6-9787-5243b12ac4ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:30.162896 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bba82851-1ddb-4bf6-9787-5243b12ac4ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:30.163308 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bba82851-1ddb-4bf6-9787-5243b12ac4ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:30.165276 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-873e8597-9408-4e84-bb35-80a7c8db2069 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:30.172901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-873e8597-9408-4e84-bb35-80a7c8db2069 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.159758 Aug 05 02:22:30.173683 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 181/361] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:30 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:30.297582 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bba82851-1ddb-4bf6-9787-5243b12ac4ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:30.304996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bba82851-1ddb-4bf6-9787-5243b12ac4ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.155463 Aug 05 02:22:30.305558 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 181/362] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:30 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:30.424652 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a064f410-ca3c-43a0-b17b-b69a3652e19f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:30.425255 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a064f410-ca3c-43a0-b17b-b69a3652e19f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:30.431114 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a064f410-ca3c-43a0-b17b-b69a3652e19f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:30.431594 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a064f410-ca3c-43a0-b17b-b69a3652e19f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:30.432726 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a064f410-ca3c-43a0-b17b-b69a3652e19f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:30.433289 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a064f410-ca3c-43a0-b17b-b69a3652e19f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:30.433747 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a064f410-ca3c-43a0-b17b-b69a3652e19f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:30.434181 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a064f410-ca3c-43a0-b17b-b69a3652e19f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:30.565988 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a064f410-ca3c-43a0-b17b-b69a3652e19f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:30.573890 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a064f410-ca3c-43a0-b17b-b69a3652e19f tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.153050 Aug 05 02:22:30.574433 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 182/363] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:30 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:30.615542 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4996b867-21ee-4093-8119-9b6c72306061 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:30.616153 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4996b867-21ee-4093-8119-9b6c72306061 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:30.622577 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4996b867-21ee-4093-8119-9b6c72306061 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:30.623060 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4996b867-21ee-4093-8119-9b6c72306061 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:30.623498 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4996b867-21ee-4093-8119-9b6c72306061 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:30.624185 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4996b867-21ee-4093-8119-9b6c72306061 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:30.624667 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4996b867-21ee-4093-8119-9b6c72306061 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:30.625094 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4996b867-21ee-4093-8119-9b6c72306061 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:30.764136 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4996b867-21ee-4093-8119-9b6c72306061 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:30.771931 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4996b867-21ee-4093-8119-9b6c72306061 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.160251 Aug 05 02:22:30.772516 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 182/364] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:30 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:31.193042 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f8a7065d-cd33-4f27-bf5c-0f9355cf6a68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:31.193648 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f8a7065d-cd33-4f27-bf5c-0f9355cf6a68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:31.200139 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8a7065d-cd33-4f27-bf5c-0f9355cf6a68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:31.200650 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8a7065d-cd33-4f27-bf5c-0f9355cf6a68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:31.201084 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8a7065d-cd33-4f27-bf5c-0f9355cf6a68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:31.201763 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8a7065d-cd33-4f27-bf5c-0f9355cf6a68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:31.202215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8a7065d-cd33-4f27-bf5c-0f9355cf6a68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:31.202635 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8a7065d-cd33-4f27-bf5c-0f9355cf6a68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:31.326754 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8a110fa6-e83b-4178-8d8a-a3a863a26f5c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:31.327368 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8a110fa6-e83b-4178-8d8a-a3a863a26f5c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:31.333600 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8a7065d-cd33-4f27-bf5c-0f9355cf6a68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:31.334146 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8a110fa6-e83b-4178-8d8a-a3a863a26f5c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:31.334706 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8a110fa6-e83b-4178-8d8a-a3a863a26f5c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:31.335227 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8a110fa6-e83b-4178-8d8a-a3a863a26f5c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:31.335900 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8a110fa6-e83b-4178-8d8a-a3a863a26f5c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:31.336392 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8a110fa6-e83b-4178-8d8a-a3a863a26f5c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:31.336819 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8a110fa6-e83b-4178-8d8a-a3a863a26f5c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:31.345054 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f8a7065d-cd33-4f27-bf5c-0f9355cf6a68 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.155488 Aug 05 02:22:31.345786 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 183/365] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:31 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:31.467595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8a110fa6-e83b-4178-8d8a-a3a863a26f5c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:31.475383 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8a110fa6-e83b-4178-8d8a-a3a863a26f5c tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.153234 Aug 05 02:22:31.476033 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 183/366] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:31 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:31.593668 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-43937494-f1e7-4fe9-88c7-437eeb5107b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:31.594301 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-43937494-f1e7-4fe9-88c7-437eeb5107b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:31.600395 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43937494-f1e7-4fe9-88c7-437eeb5107b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:31.600879 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43937494-f1e7-4fe9-88c7-437eeb5107b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:31.601316 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43937494-f1e7-4fe9-88c7-437eeb5107b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:31.601992 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43937494-f1e7-4fe9-88c7-437eeb5107b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:31.602444 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43937494-f1e7-4fe9-88c7-437eeb5107b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:31.602872 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43937494-f1e7-4fe9-88c7-437eeb5107b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:31.736586 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-43937494-f1e7-4fe9-88c7-437eeb5107b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:31.743871 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-43937494-f1e7-4fe9-88c7-437eeb5107b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.154091 Aug 05 02:22:31.744471 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 184/367] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:31 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:31.792815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0c0f7ebe-417b-4c88-990d-aaa34de5f810 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:31.793427 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0c0f7ebe-417b-4c88-990d-aaa34de5f810 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:31.799268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c0f7ebe-417b-4c88-990d-aaa34de5f810 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:31.799750 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c0f7ebe-417b-4c88-990d-aaa34de5f810 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:31.800186 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c0f7ebe-417b-4c88-990d-aaa34de5f810 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:31.800904 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c0f7ebe-417b-4c88-990d-aaa34de5f810 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:31.801360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c0f7ebe-417b-4c88-990d-aaa34de5f810 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:31.801783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0c0f7ebe-417b-4c88-990d-aaa34de5f810 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:31.930511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0c0f7ebe-417b-4c88-990d-aaa34de5f810 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:31.938929 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0c0f7ebe-417b-4c88-990d-aaa34de5f810 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.150299 Aug 05 02:22:31.939492 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 184/368] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:31 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:32.366584 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2039a760-8350-4433-97e6-a13a40282c6a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:32.367198 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2039a760-8350-4433-97e6-a13a40282c6a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:32.373865 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2039a760-8350-4433-97e6-a13a40282c6a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:32.374349 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2039a760-8350-4433-97e6-a13a40282c6a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:32.374791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2039a760-8350-4433-97e6-a13a40282c6a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:32.375473 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2039a760-8350-4433-97e6-a13a40282c6a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:32.375930 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2039a760-8350-4433-97e6-a13a40282c6a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:32.376370 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2039a760-8350-4433-97e6-a13a40282c6a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:32.496993 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6e875e84-1822-449e-bf53-8c11d0ba9607 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:32.497591 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6e875e84-1822-449e-bf53-8c11d0ba9607 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:32.503943 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e875e84-1822-449e-bf53-8c11d0ba9607 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:32.504451 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e875e84-1822-449e-bf53-8c11d0ba9607 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:32.504943 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e875e84-1822-449e-bf53-8c11d0ba9607 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:32.505546 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e875e84-1822-449e-bf53-8c11d0ba9607 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:32.505991 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e875e84-1822-449e-bf53-8c11d0ba9607 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:32.506408 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6e875e84-1822-449e-bf53-8c11d0ba9607 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:32.507859 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2039a760-8350-4433-97e6-a13a40282c6a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:32.515406 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2039a760-8350-4433-97e6-a13a40282c6a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.152893 Aug 05 02:22:32.515975 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 185/369] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:32 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:32.636203 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6e875e84-1822-449e-bf53-8c11d0ba9607 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:32.643615 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6e875e84-1822-449e-bf53-8c11d0ba9607 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.151257 Aug 05 02:22:32.644182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 185/370] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:32 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:32.764203 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-14d7f626-4fa5-442c-ae65-e1b286439185 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:32.764857 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-14d7f626-4fa5-442c-ae65-e1b286439185 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:32.770799 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14d7f626-4fa5-442c-ae65-e1b286439185 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:32.771285 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14d7f626-4fa5-442c-ae65-e1b286439185 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:32.771723 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14d7f626-4fa5-442c-ae65-e1b286439185 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:32.772434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14d7f626-4fa5-442c-ae65-e1b286439185 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:32.772893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14d7f626-4fa5-442c-ae65-e1b286439185 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:32.773321 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14d7f626-4fa5-442c-ae65-e1b286439185 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:32.900738 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-14d7f626-4fa5-442c-ae65-e1b286439185 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:32.909199 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-14d7f626-4fa5-442c-ae65-e1b286439185 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.148792 Aug 05 02:22:32.909759 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 186/371] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:32 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:32.959853 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-24b97af5-95b9-45eb-b8fd-8ceaef773bfb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:32.960486 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-24b97af5-95b9-45eb-b8fd-8ceaef773bfb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:32.966909 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24b97af5-95b9-45eb-b8fd-8ceaef773bfb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:32.967381 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24b97af5-95b9-45eb-b8fd-8ceaef773bfb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:32.967806 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24b97af5-95b9-45eb-b8fd-8ceaef773bfb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:32.968510 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24b97af5-95b9-45eb-b8fd-8ceaef773bfb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:32.968957 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24b97af5-95b9-45eb-b8fd-8ceaef773bfb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:32.969470 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24b97af5-95b9-45eb-b8fd-8ceaef773bfb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:33.099265 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-24b97af5-95b9-45eb-b8fd-8ceaef773bfb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:33.102698 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:33.108058 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-24b97af5-95b9-45eb-b8fd-8ceaef773bfb tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.151971 Aug 05 02:22:33.108649 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 186/372] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:32 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:33.536698 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4b1d5905-d0aa-412c-96b9-12bef6b8d942 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:33.537299 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4b1d5905-d0aa-412c-96b9-12bef6b8d942 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:33.543442 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b1d5905-d0aa-412c-96b9-12bef6b8d942 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:33.543912 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b1d5905-d0aa-412c-96b9-12bef6b8d942 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:33.544362 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b1d5905-d0aa-412c-96b9-12bef6b8d942 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:33.545103 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b1d5905-d0aa-412c-96b9-12bef6b8d942 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:33.545554 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b1d5905-d0aa-412c-96b9-12bef6b8d942 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:33.545972 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b1d5905-d0aa-412c-96b9-12bef6b8d942 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:33.664732 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c5d682ee-7acf-42f1-9dd4-655a498e63a9 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:33.665438 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c5d682ee-7acf-42f1-9dd4-655a498e63a9 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:33.672390 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c5d682ee-7acf-42f1-9dd4-655a498e63a9 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:33.672867 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c5d682ee-7acf-42f1-9dd4-655a498e63a9 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:33.673292 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c5d682ee-7acf-42f1-9dd4-655a498e63a9 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:33.673985 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c5d682ee-7acf-42f1-9dd4-655a498e63a9 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:33.674426 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c5d682ee-7acf-42f1-9dd4-655a498e63a9 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:33.674845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c5d682ee-7acf-42f1-9dd4-655a498e63a9 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:33.687854 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b1d5905-d0aa-412c-96b9-12bef6b8d942 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:33.691322 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:33.696355 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4b1d5905-d0aa-412c-96b9-12bef6b8d942 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.163410 Aug 05 02:22:33.696920 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 187/373] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:33 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:33.802994 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c5d682ee-7acf-42f1-9dd4-655a498e63a9 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:33.811599 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c5d682ee-7acf-42f1-9dd4-655a498e63a9 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.150926 Aug 05 02:22:33.812160 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 187/374] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:33 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:33.930124 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bb9da8a0-f18b-42e0-b136-14e0a8f69650 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:33.930729 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bb9da8a0-f18b-42e0-b136-14e0a8f69650 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:33.937651 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb9da8a0-f18b-42e0-b136-14e0a8f69650 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:33.938134 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb9da8a0-f18b-42e0-b136-14e0a8f69650 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:33.938573 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb9da8a0-f18b-42e0-b136-14e0a8f69650 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:33.939264 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb9da8a0-f18b-42e0-b136-14e0a8f69650 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:33.939715 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb9da8a0-f18b-42e0-b136-14e0a8f69650 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:33.940140 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb9da8a0-f18b-42e0-b136-14e0a8f69650 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:34.067196 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bb9da8a0-f18b-42e0-b136-14e0a8f69650 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:34.074469 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bb9da8a0-f18b-42e0-b136-14e0a8f69650 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.148176 Aug 05 02:22:34.075023 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 188/375] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:33 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:34.127994 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f6719874-cde4-4b25-870e-71bf7f5312e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:34.128621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f6719874-cde4-4b25-870e-71bf7f5312e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:34.134446 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6719874-cde4-4b25-870e-71bf7f5312e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:34.134916 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6719874-cde4-4b25-870e-71bf7f5312e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:34.135492 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6719874-cde4-4b25-870e-71bf7f5312e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:34.136174 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6719874-cde4-4b25-870e-71bf7f5312e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:34.136642 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6719874-cde4-4b25-870e-71bf7f5312e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:34.137059 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f6719874-cde4-4b25-870e-71bf7f5312e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:34.274823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f6719874-cde4-4b25-870e-71bf7f5312e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:34.283112 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f6719874-cde4-4b25-870e-71bf7f5312e9 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.158928 Aug 05 02:22:34.283657 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 188/376] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:34 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:34.717003 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3b50b6be-5914-4a5e-81d3-0468ebfec8e0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:34.717607 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3b50b6be-5914-4a5e-81d3-0468ebfec8e0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:34.723680 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b50b6be-5914-4a5e-81d3-0468ebfec8e0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:34.724159 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b50b6be-5914-4a5e-81d3-0468ebfec8e0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:34.724623 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b50b6be-5914-4a5e-81d3-0468ebfec8e0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:34.725304 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b50b6be-5914-4a5e-81d3-0468ebfec8e0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:34.725755 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b50b6be-5914-4a5e-81d3-0468ebfec8e0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:34.726175 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b50b6be-5914-4a5e-81d3-0468ebfec8e0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:34.832840 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6c75ae6d-791c-4a4b-b423-dfe8ef01ddeb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:34.833461 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6c75ae6d-791c-4a4b-b423-dfe8ef01ddeb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:34.840071 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c75ae6d-791c-4a4b-b423-dfe8ef01ddeb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:34.840597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c75ae6d-791c-4a4b-b423-dfe8ef01ddeb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:34.841042 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c75ae6d-791c-4a4b-b423-dfe8ef01ddeb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:34.841750 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c75ae6d-791c-4a4b-b423-dfe8ef01ddeb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:34.842213 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c75ae6d-791c-4a4b-b423-dfe8ef01ddeb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:34.842892 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6c75ae6d-791c-4a4b-b423-dfe8ef01ddeb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:34.853901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3b50b6be-5914-4a5e-81d3-0468ebfec8e0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:34.861430 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3b50b6be-5914-4a5e-81d3-0468ebfec8e0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.148836 Aug 05 02:22:34.861998 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 189/377] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:34 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:34.976442 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6c75ae6d-791c-4a4b-b423-dfe8ef01ddeb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:34.983825 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6c75ae6d-791c-4a4b-b423-dfe8ef01ddeb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.155107 Aug 05 02:22:34.984419 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 189/378] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:34 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:35.094356 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b184992b-8751-4493-be45-ce87fa26ba13 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:35.095225 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b184992b-8751-4493-be45-ce87fa26ba13 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:35.101046 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b184992b-8751-4493-be45-ce87fa26ba13 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:35.101526 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b184992b-8751-4493-be45-ce87fa26ba13 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:35.101993 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b184992b-8751-4493-be45-ce87fa26ba13 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:35.102667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b184992b-8751-4493-be45-ce87fa26ba13 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:35.103114 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b184992b-8751-4493-be45-ce87fa26ba13 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:35.103532 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b184992b-8751-4493-be45-ce87fa26ba13 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:35.232120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b184992b-8751-4493-be45-ce87fa26ba13 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:35.239390 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b184992b-8751-4493-be45-ce87fa26ba13 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.148812 Aug 05 02:22:35.239949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 190/379] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:35 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:35.305033 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d46edb10-be1d-40f2-8d84-27e134f8755d tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:35.305636 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d46edb10-be1d-40f2-8d84-27e134f8755d tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:35.312183 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d46edb10-be1d-40f2-8d84-27e134f8755d tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:35.312700 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d46edb10-be1d-40f2-8d84-27e134f8755d tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:35.313132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d46edb10-be1d-40f2-8d84-27e134f8755d tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:35.313816 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d46edb10-be1d-40f2-8d84-27e134f8755d tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:35.314265 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d46edb10-be1d-40f2-8d84-27e134f8755d tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:35.314690 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d46edb10-be1d-40f2-8d84-27e134f8755d tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:35.441342 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d46edb10-be1d-40f2-8d84-27e134f8755d tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:35.449284 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d46edb10-be1d-40f2-8d84-27e134f8755d tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.148062 Aug 05 02:22:35.449842 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 190/380] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:35 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:35.881846 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4603e0b3-39b3-48e7-aa8b-ea4ebe3a6264 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:35.882481 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4603e0b3-39b3-48e7-aa8b-ea4ebe3a6264 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:35.889076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4603e0b3-39b3-48e7-aa8b-ea4ebe3a6264 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:35.889560 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4603e0b3-39b3-48e7-aa8b-ea4ebe3a6264 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:35.889995 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4603e0b3-39b3-48e7-aa8b-ea4ebe3a6264 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:35.890679 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4603e0b3-39b3-48e7-aa8b-ea4ebe3a6264 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:35.891131 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4603e0b3-39b3-48e7-aa8b-ea4ebe3a6264 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:35.891577 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4603e0b3-39b3-48e7-aa8b-ea4ebe3a6264 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:36.004957 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5e5e82c5-1360-40d6-8882-53dfdd74ea17 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:36.005657 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5e5e82c5-1360-40d6-8882-53dfdd74ea17 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:36.012050 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e5e82c5-1360-40d6-8882-53dfdd74ea17 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:36.012646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e5e82c5-1360-40d6-8882-53dfdd74ea17 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:36.013152 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e5e82c5-1360-40d6-8882-53dfdd74ea17 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:36.013938 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e5e82c5-1360-40d6-8882-53dfdd74ea17 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:36.014516 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e5e82c5-1360-40d6-8882-53dfdd74ea17 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:36.014999 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5e5e82c5-1360-40d6-8882-53dfdd74ea17 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:36.017182 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4603e0b3-39b3-48e7-aa8b-ea4ebe3a6264 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:36.024643 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4603e0b3-39b3-48e7-aa8b-ea4ebe3a6264 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.146569 Aug 05 02:22:36.025205 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 191/381] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:35 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:36.145086 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5e5e82c5-1360-40d6-8882-53dfdd74ea17 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:36.152652 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5e5e82c5-1360-40d6-8882-53dfdd74ea17 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.151486 Aug 05 02:22:36.153210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 191/382] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:35 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:36.260240 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a05f80b1-89b4-4cf2-8303-4816d6b57d12 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:36.260932 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a05f80b1-89b4-4cf2-8303-4816d6b57d12 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:36.266586 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a05f80b1-89b4-4cf2-8303-4816d6b57d12 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:36.267059 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a05f80b1-89b4-4cf2-8303-4816d6b57d12 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:36.267488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a05f80b1-89b4-4cf2-8303-4816d6b57d12 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:36.268161 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a05f80b1-89b4-4cf2-8303-4816d6b57d12 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:36.268664 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a05f80b1-89b4-4cf2-8303-4816d6b57d12 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:36.269081 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a05f80b1-89b4-4cf2-8303-4816d6b57d12 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:36.397694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a05f80b1-89b4-4cf2-8303-4816d6b57d12 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:36.406415 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a05f80b1-89b4-4cf2-8303-4816d6b57d12 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.149781 Aug 05 02:22:36.406750 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 192/383] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:36 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:36.470575 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-91e43469-449b-4a22-bd1d-0f0e3dc8e9f6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:36.471212 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-91e43469-449b-4a22-bd1d-0f0e3dc8e9f6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:36.477184 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-91e43469-449b-4a22-bd1d-0f0e3dc8e9f6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:36.477546 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-91e43469-449b-4a22-bd1d-0f0e3dc8e9f6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:36.478005 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-91e43469-449b-4a22-bd1d-0f0e3dc8e9f6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:36.479454 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-91e43469-449b-4a22-bd1d-0f0e3dc8e9f6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:36.479905 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-91e43469-449b-4a22-bd1d-0f0e3dc8e9f6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:36.480348 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-91e43469-449b-4a22-bd1d-0f0e3dc8e9f6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:36.512616 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-1523b82c-144e-4728-a2da-db90d2b4d204 req-adf00379-25ce-456e-b329-28ca7f629c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3", "name": "network-vif-unplugged", "status": "completed", "tag": "9d9c2151-858a-4f4b-ae99-508b1aadb74a"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:22:36.522582 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1523b82c-144e-4728-a2da-db90d2b4d204 req-adf00379-25ce-456e-b329-28ca7f629c0c service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:36.523134 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1523b82c-144e-4728-a2da-db90d2b4d204 req-adf00379-25ce-456e-b329-28ca7f629c0c service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:36.523709 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1523b82c-144e-4728-a2da-db90d2b4d204 req-adf00379-25ce-456e-b329-28ca7f629c0c service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:36.537219 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-1523b82c-144e-4728-a2da-db90d2b4d204 req-adf00379-25ce-456e-b329-28ca7f629c0c service nova] Creating event network-vif-unplugged:9d9c2151-858a-4f4b-ae99-508b1aadb74a for instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 on hv-cinder-81558 Aug 05 02:22:36.543454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-1523b82c-144e-4728-a2da-db90d2b4d204 req-adf00379-25ce-456e-b329-28ca7f629c0c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035323 Aug 05 02:22:36.544654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 193/384] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:22:36.614713 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-91e43469-449b-4a22-bd1d-0f0e3dc8e9f6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:36.623115 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-91e43469-449b-4a22-bd1d-0f0e3dc8e9f6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.156749 Aug 05 02:22:36.623663 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 192/385] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:36 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:37.045941 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-379a6128-9dc4-4a62-a01d-c8ed1cb57f13 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:37.046633 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-379a6128-9dc4-4a62-a01d-c8ed1cb57f13 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:37.052722 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-379a6128-9dc4-4a62-a01d-c8ed1cb57f13 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:37.053205 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-379a6128-9dc4-4a62-a01d-c8ed1cb57f13 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:37.053638 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-379a6128-9dc4-4a62-a01d-c8ed1cb57f13 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:37.054337 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-379a6128-9dc4-4a62-a01d-c8ed1cb57f13 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:37.054769 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-379a6128-9dc4-4a62-a01d-c8ed1cb57f13 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:37.055182 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-379a6128-9dc4-4a62-a01d-c8ed1cb57f13 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:37.173013 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-70f5ecd4-655d-4df8-a05c-c4de7c9f3fa0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:37.174195 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-70f5ecd4-655d-4df8-a05c-c4de7c9f3fa0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:37.180597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70f5ecd4-655d-4df8-a05c-c4de7c9f3fa0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:37.181079 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70f5ecd4-655d-4df8-a05c-c4de7c9f3fa0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:37.181510 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70f5ecd4-655d-4df8-a05c-c4de7c9f3fa0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:37.182878 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70f5ecd4-655d-4df8-a05c-c4de7c9f3fa0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:37.183503 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70f5ecd4-655d-4df8-a05c-c4de7c9f3fa0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:37.183930 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70f5ecd4-655d-4df8-a05c-c4de7c9f3fa0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:37.190736 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-379a6128-9dc4-4a62-a01d-c8ed1cb57f13 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:37.198947 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-379a6128-9dc4-4a62-a01d-c8ed1cb57f13 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.157754 Aug 05 02:22:37.199754 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 194/386] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:37 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:37.427016 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-77d9f257-e3d6-4328-b272-97ee0d0a76f4 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:37.427654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-77d9f257-e3d6-4328-b272-97ee0d0a76f4 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:37.434131 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d9f257-e3d6-4328-b272-97ee0d0a76f4 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:37.434612 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d9f257-e3d6-4328-b272-97ee0d0a76f4 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:37.435043 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d9f257-e3d6-4328-b272-97ee0d0a76f4 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:37.435727 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d9f257-e3d6-4328-b272-97ee0d0a76f4 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:37.436178 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d9f257-e3d6-4328-b272-97ee0d0a76f4 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:37.436630 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77d9f257-e3d6-4328-b272-97ee0d0a76f4 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:37.567337 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-77d9f257-e3d6-4328-b272-97ee0d0a76f4 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:37.575920 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-77d9f257-e3d6-4328-b272-97ee0d0a76f4 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.152623 Aug 05 02:22:37.576716 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 195/387] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:37 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:37.643915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4181ccbd-38a2-4e1e-ab99-99dae1c1bb3f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:37.644555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4181ccbd-38a2-4e1e-ab99-99dae1c1bb3f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:37.650424 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4181ccbd-38a2-4e1e-ab99-99dae1c1bb3f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:37.651176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4181ccbd-38a2-4e1e-ab99-99dae1c1bb3f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:37.651651 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4181ccbd-38a2-4e1e-ab99-99dae1c1bb3f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:37.652439 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4181ccbd-38a2-4e1e-ab99-99dae1c1bb3f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:37.652906 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4181ccbd-38a2-4e1e-ab99-99dae1c1bb3f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:37.653335 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4181ccbd-38a2-4e1e-ab99-99dae1c1bb3f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:37.761870 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-70f5ecd4-655d-4df8-a05c-c4de7c9f3fa0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:37.780471 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-70f5ecd4-655d-4df8-a05c-c4de7c9f3fa0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.611106 Aug 05 02:22:37.794923 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 193/388] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:37 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:37.818845 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4181ccbd-38a2-4e1e-ab99-99dae1c1bb3f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:37.829577 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4181ccbd-38a2-4e1e-ab99-99dae1c1bb3f tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1554 microversion: 2.1 time: 0.189432 Aug 05 02:22:37.830148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 196/389] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:37 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:38.015262 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-1a5777f0-4bf1-4f8f-b3a6-ad4623cd9152 req-7aabee26-d7c4-48b5-804e-74f547a93962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3", "name": "network-vif-deleted", "tag": "9d9c2151-858a-4f4b-ae99-508b1aadb74a"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:22:38.024700 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-1a5777f0-4bf1-4f8f-b3a6-ad4623cd9152 req-7aabee26-d7c4-48b5-804e-74f547a93962 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:38.025380 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-1a5777f0-4bf1-4f8f-b3a6-ad4623cd9152 req-7aabee26-d7c4-48b5-804e-74f547a93962 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:38.026515 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-1a5777f0-4bf1-4f8f-b3a6-ad4623cd9152 req-7aabee26-d7c4-48b5-804e-74f547a93962 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:38.038404 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-1a5777f0-4bf1-4f8f-b3a6-ad4623cd9152 req-7aabee26-d7c4-48b5-804e-74f547a93962 service nova] Creating event network-vif-deleted:9d9c2151-858a-4f4b-ae99-508b1aadb74a for instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 on hv-cinder-81558 Aug 05 02:22:38.044076 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-1a5777f0-4bf1-4f8f-b3a6-ad4623cd9152 req-7aabee26-d7c4-48b5-804e-74f547a93962 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032516 Aug 05 02:22:38.044719 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 194/390] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:22:38.220301 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b74121fe-737e-469a-b933-672f4a5441f9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:38.220857 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b74121fe-737e-469a-b933-672f4a5441f9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:38.226916 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b74121fe-737e-469a-b933-672f4a5441f9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:38.227397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b74121fe-737e-469a-b933-672f4a5441f9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:38.227824 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b74121fe-737e-469a-b933-672f4a5441f9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:38.228589 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b74121fe-737e-469a-b933-672f4a5441f9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:38.229041 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b74121fe-737e-469a-b933-672f4a5441f9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:38.229646 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b74121fe-737e-469a-b933-672f4a5441f9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:38.355038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b74121fe-737e-469a-b933-672f4a5441f9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:38.362297 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b74121fe-737e-469a-b933-672f4a5441f9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.146125 Aug 05 02:22:38.362851 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 197/391] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:38 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:38.598411 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7e211e24-6d97-4c12-b5a8-a78af7fbf6b5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:38.599117 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7e211e24-6d97-4c12-b5a8-a78af7fbf6b5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:38.601125 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:38.607493 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e211e24-6d97-4c12-b5a8-a78af7fbf6b5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:38.608188 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e211e24-6d97-4c12-b5a8-a78af7fbf6b5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:38.608633 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e211e24-6d97-4c12-b5a8-a78af7fbf6b5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:38.609406 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e211e24-6d97-4c12-b5a8-a78af7fbf6b5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:38.609781 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e211e24-6d97-4c12-b5a8-a78af7fbf6b5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:38.610205 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e211e24-6d97-4c12-b5a8-a78af7fbf6b5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:38.745071 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7e211e24-6d97-4c12-b5a8-a78af7fbf6b5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:38.754311 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7e211e24-6d97-4c12-b5a8-a78af7fbf6b5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.160403 Aug 05 02:22:38.755332 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 195/392] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:38 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:38.800818 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1ca45b1f-b232-43af-b4d0-c5e071a5ec27 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:38.801431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1ca45b1f-b232-43af-b4d0-c5e071a5ec27 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:38.807757 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ca45b1f-b232-43af-b4d0-c5e071a5ec27 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:38.808239 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ca45b1f-b232-43af-b4d0-c5e071a5ec27 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:38.808699 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ca45b1f-b232-43af-b4d0-c5e071a5ec27 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:38.809382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ca45b1f-b232-43af-b4d0-c5e071a5ec27 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:38.809836 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ca45b1f-b232-43af-b4d0-c5e071a5ec27 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:38.810259 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ca45b1f-b232-43af-b4d0-c5e071a5ec27 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:38.854175 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8ef558ea-5a37-4743-9ed0-6c4e76bc540b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:38.855403 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8ef558ea-5a37-4743-9ed0-6c4e76bc540b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:38.861259 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ef558ea-5a37-4743-9ed0-6c4e76bc540b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:38.861740 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ef558ea-5a37-4743-9ed0-6c4e76bc540b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:38.862171 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ef558ea-5a37-4743-9ed0-6c4e76bc540b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:38.862855 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ef558ea-5a37-4743-9ed0-6c4e76bc540b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:38.863301 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ef558ea-5a37-4743-9ed0-6c4e76bc540b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:38.863720 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ef558ea-5a37-4743-9ed0-6c4e76bc540b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:38.925802 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8ef558ea-5a37-4743-9ed0-6c4e76bc540b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:38.933834 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8ef558ea-5a37-4743-9ed0-6c4e76bc540b tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1512 microversion: 2.1 time: 0.084095 Aug 05 02:22:38.934405 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 196/393] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:38 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1512 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:38.945253 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1ca45b1f-b232-43af-b4d0-c5e071a5ec27 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:38.953233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1ca45b1f-b232-43af-b4d0-c5e071a5ec27 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.156189 Aug 05 02:22:38.953796 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 198/394] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:38 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:39.383038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e16e22e4-a1a9-493b-bd8a-804733afc485 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:39.383583 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e16e22e4-a1a9-493b-bd8a-804733afc485 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:39.390504 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e16e22e4-a1a9-493b-bd8a-804733afc485 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:39.390982 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e16e22e4-a1a9-493b-bd8a-804733afc485 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:39.391405 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e16e22e4-a1a9-493b-bd8a-804733afc485 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:39.392086 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e16e22e4-a1a9-493b-bd8a-804733afc485 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:39.392558 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e16e22e4-a1a9-493b-bd8a-804733afc485 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:39.392994 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e16e22e4-a1a9-493b-bd8a-804733afc485 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:39.535889 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e16e22e4-a1a9-493b-bd8a-804733afc485 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:39.543416 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e16e22e4-a1a9-493b-bd8a-804733afc485 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.164338 Aug 05 02:22:39.543986 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 197/395] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:39 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:39.775887 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bafbe8b5-7f32-4dee-a504-64d146cc261d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:39.776523 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bafbe8b5-7f32-4dee-a504-64d146cc261d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:39.782485 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bafbe8b5-7f32-4dee-a504-64d146cc261d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:39.782972 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bafbe8b5-7f32-4dee-a504-64d146cc261d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:39.783404 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bafbe8b5-7f32-4dee-a504-64d146cc261d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:39.784080 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bafbe8b5-7f32-4dee-a504-64d146cc261d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:39.784556 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bafbe8b5-7f32-4dee-a504-64d146cc261d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:39.784980 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bafbe8b5-7f32-4dee-a504-64d146cc261d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:39.910775 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bafbe8b5-7f32-4dee-a504-64d146cc261d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:39.918974 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bafbe8b5-7f32-4dee-a504-64d146cc261d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.147194 Aug 05 02:22:39.919529 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 199/396] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:39 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:39.953574 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-799ec670-6a42-49cd-ac47-340c423e86b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:39.954175 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-799ec670-6a42-49cd-ac47-340c423e86b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:39.960557 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-799ec670-6a42-49cd-ac47-340c423e86b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:39.961030 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-799ec670-6a42-49cd-ac47-340c423e86b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:39.961453 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-799ec670-6a42-49cd-ac47-340c423e86b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:39.962125 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-799ec670-6a42-49cd-ac47-340c423e86b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:39.962567 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-799ec670-6a42-49cd-ac47-340c423e86b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:39.963216 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-799ec670-6a42-49cd-ac47-340c423e86b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:39.974675 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-633e0b22-051c-431d-8cb8-dd18d7f4a3ca tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:39.975303 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-633e0b22-051c-431d-8cb8-dd18d7f4a3ca tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:39.982678 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-633e0b22-051c-431d-8cb8-dd18d7f4a3ca tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:39.982678 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-633e0b22-051c-431d-8cb8-dd18d7f4a3ca tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:39.983047 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-633e0b22-051c-431d-8cb8-dd18d7f4a3ca tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:39.983730 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-633e0b22-051c-431d-8cb8-dd18d7f4a3ca tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:39.984173 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-633e0b22-051c-431d-8cb8-dd18d7f4a3ca tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:39.984609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-633e0b22-051c-431d-8cb8-dd18d7f4a3ca tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:40.030470 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-799ec670-6a42-49cd-ac47-340c423e86b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:40.038808 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-799ec670-6a42-49cd-ac47-340c423e86b0 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1346 microversion: 2.1 time: 0.088924 Aug 05 02:22:40.039613 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 198/397] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:39 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:40.120908 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-633e0b22-051c-431d-8cb8-dd18d7f4a3ca tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:40.128177 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-633e0b22-051c-431d-8cb8-dd18d7f4a3ca tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.157254 Aug 05 02:22:40.128767 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 200/398] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:39 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:40.565013 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-89ae0717-a9da-49c5-8561-de204b857364 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:40.565615 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-89ae0717-a9da-49c5-8561-de204b857364 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:40.571424 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89ae0717-a9da-49c5-8561-de204b857364 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:40.571903 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89ae0717-a9da-49c5-8561-de204b857364 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:40.572897 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89ae0717-a9da-49c5-8561-de204b857364 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:40.573628 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89ae0717-a9da-49c5-8561-de204b857364 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:40.574325 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89ae0717-a9da-49c5-8561-de204b857364 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:40.574754 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-89ae0717-a9da-49c5-8561-de204b857364 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:40.707147 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-89ae0717-a9da-49c5-8561-de204b857364 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:40.715399 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-89ae0717-a9da-49c5-8561-de204b857364 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.154202 Aug 05 02:22:40.715945 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 199/399] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:40 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:40.938966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9a35f6d7-4942-4801-9b23-fb3c7faaf5f3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:40.939567 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9a35f6d7-4942-4801-9b23-fb3c7faaf5f3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:40.945789 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a35f6d7-4942-4801-9b23-fb3c7faaf5f3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:40.946261 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a35f6d7-4942-4801-9b23-fb3c7faaf5f3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:40.946696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a35f6d7-4942-4801-9b23-fb3c7faaf5f3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:40.947968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a35f6d7-4942-4801-9b23-fb3c7faaf5f3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:40.948437 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a35f6d7-4942-4801-9b23-fb3c7faaf5f3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:40.948857 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a35f6d7-4942-4801-9b23-fb3c7faaf5f3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:41.059893 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c83a4dea-b68e-4ffe-a2c4-727a8ac69a61 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:41.060762 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c83a4dea-b68e-4ffe-a2c4-727a8ac69a61 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:41.066989 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c83a4dea-b68e-4ffe-a2c4-727a8ac69a61 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:41.067465 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c83a4dea-b68e-4ffe-a2c4-727a8ac69a61 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:41.067956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c83a4dea-b68e-4ffe-a2c4-727a8ac69a61 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:41.068666 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c83a4dea-b68e-4ffe-a2c4-727a8ac69a61 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:41.069113 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c83a4dea-b68e-4ffe-a2c4-727a8ac69a61 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:41.069530 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c83a4dea-b68e-4ffe-a2c4-727a8ac69a61 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:41.075839 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9a35f6d7-4942-4801-9b23-fb3c7faaf5f3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:41.083270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9a35f6d7-4942-4801-9b23-fb3c7faaf5f3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.148371 Aug 05 02:22:41.083830 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 201/400] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:40 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:41.132882 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c83a4dea-b68e-4ffe-a2c4-727a8ac69a61 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:41.141280 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c83a4dea-b68e-4ffe-a2c4-727a8ac69a61 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1346 microversion: 2.1 time: 0.085984 Aug 05 02:22:41.141834 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 200/401] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:41 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:41.148596 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2ff62b52-31ee-40aa-971d-b48d7365b863 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:41.149382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2ff62b52-31ee-40aa-971d-b48d7365b863 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:41.155507 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ff62b52-31ee-40aa-971d-b48d7365b863 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:41.155988 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ff62b52-31ee-40aa-971d-b48d7365b863 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:41.156472 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ff62b52-31ee-40aa-971d-b48d7365b863 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:41.157159 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ff62b52-31ee-40aa-971d-b48d7365b863 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:41.157613 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ff62b52-31ee-40aa-971d-b48d7365b863 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:41.158039 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ff62b52-31ee-40aa-971d-b48d7365b863 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:41.290379 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2ff62b52-31ee-40aa-971d-b48d7365b863 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:41.298237 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2ff62b52-31ee-40aa-971d-b48d7365b863 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.153497 Aug 05 02:22:41.298793 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 202/402] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:41 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:41.736498 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f0ee9270-0d07-449c-9c24-f65e665e469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:41.737107 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f0ee9270-0d07-449c-9c24-f65e665e469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:41.743071 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0ee9270-0d07-449c-9c24-f65e665e469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:41.743550 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0ee9270-0d07-449c-9c24-f65e665e469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:41.744569 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0ee9270-0d07-449c-9c24-f65e665e469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:41.745269 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0ee9270-0d07-449c-9c24-f65e665e469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:41.745756 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0ee9270-0d07-449c-9c24-f65e665e469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:41.746179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0ee9270-0d07-449c-9c24-f65e665e469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:41.872628 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f0ee9270-0d07-449c-9c24-f65e665e469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:41.879943 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f0ee9270-0d07-449c-9c24-f65e665e469f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.147316 Aug 05 02:22:41.880530 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 201/403] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:41 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:42.104601 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e7abfb5-f3e7-413b-bb1c-233e2c166912 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:42.105266 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7e7abfb5-f3e7-413b-bb1c-233e2c166912 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:42.111167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e7abfb5-f3e7-413b-bb1c-233e2c166912 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:42.111640 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e7abfb5-f3e7-413b-bb1c-233e2c166912 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:42.112067 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e7abfb5-f3e7-413b-bb1c-233e2c166912 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:42.112774 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e7abfb5-f3e7-413b-bb1c-233e2c166912 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:42.113218 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e7abfb5-f3e7-413b-bb1c-233e2c166912 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:42.113638 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e7abfb5-f3e7-413b-bb1c-233e2c166912 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:42.162243 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-83c64be1-4dca-48ef-b3b2-f57166513218 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:42.162854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-83c64be1-4dca-48ef-b3b2-f57166513218 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:42.179416 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83c64be1-4dca-48ef-b3b2-f57166513218 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:42.180205 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83c64be1-4dca-48ef-b3b2-f57166513218 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:42.180670 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83c64be1-4dca-48ef-b3b2-f57166513218 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:42.181380 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83c64be1-4dca-48ef-b3b2-f57166513218 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:42.182612 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83c64be1-4dca-48ef-b3b2-f57166513218 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:42.183297 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-83c64be1-4dca-48ef-b3b2-f57166513218 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:42.263573 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7e7abfb5-f3e7-413b-bb1c-233e2c166912 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:42.271340 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7e7abfb5-f3e7-413b-bb1c-233e2c166912 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.171046 Aug 05 02:22:42.272314 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 203/404] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:42 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:42.286170 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-83c64be1-4dca-48ef-b3b2-f57166513218 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:42.294505 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-83c64be1-4dca-48ef-b3b2-f57166513218 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1346 microversion: 2.1 time: 0.137287 Aug 05 02:22:42.295146 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 202/405] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:42 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1346 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:42.318758 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-24cf4167-ba47-4b6e-b706-7fa0c3aa2513 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:42.319360 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-24cf4167-ba47-4b6e-b706-7fa0c3aa2513 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:42.325890 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24cf4167-ba47-4b6e-b706-7fa0c3aa2513 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:42.326361 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24cf4167-ba47-4b6e-b706-7fa0c3aa2513 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:42.326788 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24cf4167-ba47-4b6e-b706-7fa0c3aa2513 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:42.327457 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24cf4167-ba47-4b6e-b706-7fa0c3aa2513 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:42.327900 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24cf4167-ba47-4b6e-b706-7fa0c3aa2513 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:42.328314 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24cf4167-ba47-4b6e-b706-7fa0c3aa2513 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:42.453688 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-24cf4167-ba47-4b6e-b706-7fa0c3aa2513 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:42.460982 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-24cf4167-ba47-4b6e-b706-7fa0c3aa2513 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.146021 Aug 05 02:22:42.461581 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 204/406] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:42 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:42.900647 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4e03ccd5-6779-4be9-ab3c-da7c3e025a8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:42.901253 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4e03ccd5-6779-4be9-ab3c-da7c3e025a8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:42.907423 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4e03ccd5-6779-4be9-ab3c-da7c3e025a8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:42.907895 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4e03ccd5-6779-4be9-ab3c-da7c3e025a8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:42.908344 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4e03ccd5-6779-4be9-ab3c-da7c3e025a8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:42.909393 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4e03ccd5-6779-4be9-ab3c-da7c3e025a8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:42.909845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4e03ccd5-6779-4be9-ab3c-da7c3e025a8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:42.910262 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4e03ccd5-6779-4be9-ab3c-da7c3e025a8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:43.043179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4e03ccd5-6779-4be9-ab3c-da7c3e025a8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:43.050514 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4e03ccd5-6779-4be9-ab3c-da7c3e025a8a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.153660 Aug 05 02:22:43.051077 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 203/407] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:42 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:43.293546 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ba3629e2-2399-4618-b470-cee143afde94 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:43.294181 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ba3629e2-2399-4618-b470-cee143afde94 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:43.300067 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba3629e2-2399-4618-b470-cee143afde94 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:43.300580 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba3629e2-2399-4618-b470-cee143afde94 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:43.301012 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba3629e2-2399-4618-b470-cee143afde94 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:43.301694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba3629e2-2399-4618-b470-cee143afde94 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:43.302145 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba3629e2-2399-4618-b470-cee143afde94 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:43.302592 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba3629e2-2399-4618-b470-cee143afde94 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:43.307197 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:43.314942 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3e76a62c-c5a3-4d0b-8bb3-b9aa8bbf2479 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:43.315622 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3e76a62c-c5a3-4d0b-8bb3-b9aa8bbf2479 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:43.323890 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e76a62c-c5a3-4d0b-8bb3-b9aa8bbf2479 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:43.324231 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e76a62c-c5a3-4d0b-8bb3-b9aa8bbf2479 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:43.325012 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e76a62c-c5a3-4d0b-8bb3-b9aa8bbf2479 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:43.325657 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e76a62c-c5a3-4d0b-8bb3-b9aa8bbf2479 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:43.326108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e76a62c-c5a3-4d0b-8bb3-b9aa8bbf2479 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:43.326527 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e76a62c-c5a3-4d0b-8bb3-b9aa8bbf2479 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:43.330724 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:43.389995 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3e76a62c-c5a3-4d0b-8bb3-b9aa8bbf2479 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:43.397917 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3e76a62c-c5a3-4d0b-8bb3-b9aa8bbf2479 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1346 microversion: 2.1 time: 0.086838 Aug 05 02:22:43.398484 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 204/408] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:43 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:43.439399 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ba3629e2-2399-4618-b470-cee143afde94 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:43.446769 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ba3629e2-2399-4618-b470-cee143afde94 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.158324 Aug 05 02:22:43.447780 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 205/409] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:43 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:43.482590 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-01c1e0c7-2a31-4991-a478-7cfdc968bbe6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:43.483129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-01c1e0c7-2a31-4991-a478-7cfdc968bbe6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:43.488880 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01c1e0c7-2a31-4991-a478-7cfdc968bbe6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:43.489350 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01c1e0c7-2a31-4991-a478-7cfdc968bbe6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:43.489773 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01c1e0c7-2a31-4991-a478-7cfdc968bbe6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:43.490443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01c1e0c7-2a31-4991-a478-7cfdc968bbe6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:43.490886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01c1e0c7-2a31-4991-a478-7cfdc968bbe6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:43.491299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01c1e0c7-2a31-4991-a478-7cfdc968bbe6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:43.686557 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-01c1e0c7-2a31-4991-a478-7cfdc968bbe6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:43.693859 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-01c1e0c7-2a31-4991-a478-7cfdc968bbe6 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.215683 Aug 05 02:22:43.694427 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 205/410] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:43 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:44.071337 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8bfc6241-04b1-4947-8ed3-5130a683cb29 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:44.071876 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8bfc6241-04b1-4947-8ed3-5130a683cb29 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:44.077899 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8bfc6241-04b1-4947-8ed3-5130a683cb29 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:44.078372 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8bfc6241-04b1-4947-8ed3-5130a683cb29 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:44.078801 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8bfc6241-04b1-4947-8ed3-5130a683cb29 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:44.079468 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8bfc6241-04b1-4947-8ed3-5130a683cb29 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:44.079913 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8bfc6241-04b1-4947-8ed3-5130a683cb29 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:44.080351 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8bfc6241-04b1-4947-8ed3-5130a683cb29 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:44.206536 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8bfc6241-04b1-4947-8ed3-5130a683cb29 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:44.214807 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8bfc6241-04b1-4947-8ed3-5130a683cb29 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.147388 Aug 05 02:22:44.215364 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 206/411] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:44 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:44.418122 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-894e204a-8c1e-409d-a325-0e2caedfb2d6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:44.418764 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-894e204a-8c1e-409d-a325-0e2caedfb2d6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:44.425133 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-894e204a-8c1e-409d-a325-0e2caedfb2d6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:44.425612 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-894e204a-8c1e-409d-a325-0e2caedfb2d6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:44.426047 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-894e204a-8c1e-409d-a325-0e2caedfb2d6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:44.426731 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-894e204a-8c1e-409d-a325-0e2caedfb2d6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:44.427182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-894e204a-8c1e-409d-a325-0e2caedfb2d6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:44.427606 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-894e204a-8c1e-409d-a325-0e2caedfb2d6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:44.468113 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e26d582a-35c2-4ad2-94b3-efb7db6169c7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:44.468749 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e26d582a-35c2-4ad2-94b3-efb7db6169c7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:44.475151 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e26d582a-35c2-4ad2-94b3-efb7db6169c7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:44.475636 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e26d582a-35c2-4ad2-94b3-efb7db6169c7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:44.476077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e26d582a-35c2-4ad2-94b3-efb7db6169c7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:44.476798 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e26d582a-35c2-4ad2-94b3-efb7db6169c7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:44.477255 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e26d582a-35c2-4ad2-94b3-efb7db6169c7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:44.477680 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e26d582a-35c2-4ad2-94b3-efb7db6169c7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:44.493161 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-894e204a-8c1e-409d-a325-0e2caedfb2d6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:44.501560 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-894e204a-8c1e-409d-a325-0e2caedfb2d6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1346 microversion: 2.1 time: 0.087317 Aug 05 02:22:44.502149 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 206/412] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:44 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:44.608692 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e26d582a-35c2-4ad2-94b3-efb7db6169c7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:44.616061 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e26d582a-35c2-4ad2-94b3-efb7db6169c7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.151691 Aug 05 02:22:44.616639 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 207/413] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:44 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:44.716123 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-70e64e8f-da5d-42d5-a7cc-2635abd70c0b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:44.716891 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-70e64e8f-da5d-42d5-a7cc-2635abd70c0b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:44.722886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70e64e8f-da5d-42d5-a7cc-2635abd70c0b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:44.723366 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70e64e8f-da5d-42d5-a7cc-2635abd70c0b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:44.723805 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70e64e8f-da5d-42d5-a7cc-2635abd70c0b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:44.724519 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70e64e8f-da5d-42d5-a7cc-2635abd70c0b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:44.724973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70e64e8f-da5d-42d5-a7cc-2635abd70c0b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:44.725405 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70e64e8f-da5d-42d5-a7cc-2635abd70c0b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:44.862232 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-70e64e8f-da5d-42d5-a7cc-2635abd70c0b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:44.870182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-70e64e8f-da5d-42d5-a7cc-2635abd70c0b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.158884 Aug 05 02:22:44.870754 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 207/414] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:44 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:45.132414 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-9a7c233d-ab7b-458b-a940-d763d2d23de0 req-04882e5b-b595-4108-be31-6e99727c2061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c8e9d9-004f-4693-a78d-77027c30aede", "name": "network-vif-plugged", "status": "completed", "tag": "9017b9e3-fdca-4fff-a053-ec122ab62248"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:22:45.137458 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:45.143383 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9a7c233d-ab7b-458b-a940-d763d2d23de0 req-04882e5b-b595-4108-be31-6e99727c2061 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:45.143858 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9a7c233d-ab7b-458b-a940-d763d2d23de0 req-04882e5b-b595-4108-be31-6e99727c2061 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:45.144281 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9a7c233d-ab7b-458b-a940-d763d2d23de0 req-04882e5b-b595-4108-be31-6e99727c2061 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:45.155557 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-9a7c233d-ab7b-458b-a940-d763d2d23de0 req-04882e5b-b595-4108-be31-6e99727c2061 service nova] Creating event network-vif-plugged:9017b9e3-fdca-4fff-a053-ec122ab62248 for instance d5c8e9d9-004f-4693-a78d-77027c30aede on hv-cinder-81558 Aug 05 02:22:45.160566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-9a7c233d-ab7b-458b-a940-d763d2d23de0 req-04882e5b-b595-4108-be31-6e99727c2061 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031844 Aug 05 02:22:45.161153 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 208/415] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:22:45.235559 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-24c8b4d8-8fa2-4b9d-bffc-642eda18ebb1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:45.236155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-24c8b4d8-8fa2-4b9d-bffc-642eda18ebb1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:45.241992 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24c8b4d8-8fa2-4b9d-bffc-642eda18ebb1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:45.242468 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24c8b4d8-8fa2-4b9d-bffc-642eda18ebb1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:45.242897 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24c8b4d8-8fa2-4b9d-bffc-642eda18ebb1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:45.243565 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24c8b4d8-8fa2-4b9d-bffc-642eda18ebb1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:45.244863 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24c8b4d8-8fa2-4b9d-bffc-642eda18ebb1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:45.245542 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24c8b4d8-8fa2-4b9d-bffc-642eda18ebb1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:45.380261 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-24c8b4d8-8fa2-4b9d-bffc-642eda18ebb1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:45.387670 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-24c8b4d8-8fa2-4b9d-bffc-642eda18ebb1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.155952 Aug 05 02:22:45.388228 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 208/416] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:45 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:45.522563 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-834f049c-7045-465f-a4db-57a846e71f38 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:45.523327 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-834f049c-7045-465f-a4db-57a846e71f38 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:45.530524 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-834f049c-7045-465f-a4db-57a846e71f38 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:45.531020 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-834f049c-7045-465f-a4db-57a846e71f38 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:45.531655 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-834f049c-7045-465f-a4db-57a846e71f38 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:45.532405 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-834f049c-7045-465f-a4db-57a846e71f38 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:45.533529 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-834f049c-7045-465f-a4db-57a846e71f38 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:45.533983 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-834f049c-7045-465f-a4db-57a846e71f38 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:45.564670 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-834f049c-7045-465f-a4db-57a846e71f38 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:45.565150 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-834f049c-7045-465f-a4db-57a846e71f38 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:45.565589 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-834f049c-7045-465f-a4db-57a846e71f38 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:45.566058 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-834f049c-7045-465f-a4db-57a846e71f38 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lazy-loading 'fault' on Instance uuid 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:22:45.611358 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-834f049c-7045-465f-a4db-57a846e71f38 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:45.620021 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-834f049c-7045-465f-a4db-57a846e71f38 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1351 microversion: 2.1 time: 0.101672 Aug 05 02:22:45.620520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 209/417] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:45 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:45.637990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5574a0f3-f885-4802-a21a-18a8b71eb6d8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:45.638748 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5574a0f3-f885-4802-a21a-18a8b71eb6d8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:45.645456 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5574a0f3-f885-4802-a21a-18a8b71eb6d8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:45.645937 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5574a0f3-f885-4802-a21a-18a8b71eb6d8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:45.646361 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5574a0f3-f885-4802-a21a-18a8b71eb6d8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:45.647045 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5574a0f3-f885-4802-a21a-18a8b71eb6d8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:45.647484 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5574a0f3-f885-4802-a21a-18a8b71eb6d8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:45.647891 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5574a0f3-f885-4802-a21a-18a8b71eb6d8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:45.788288 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5574a0f3-f885-4802-a21a-18a8b71eb6d8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:45.795807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5574a0f3-f885-4802-a21a-18a8b71eb6d8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.162266 Aug 05 02:22:45.796397 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 209/418] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:45 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:45.892648 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ec147f9d-7c04-4719-a1af-56bf820e424e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:45.893486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ec147f9d-7c04-4719-a1af-56bf820e424e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:45.900253 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec147f9d-7c04-4719-a1af-56bf820e424e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:45.901118 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec147f9d-7c04-4719-a1af-56bf820e424e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:45.901730 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec147f9d-7c04-4719-a1af-56bf820e424e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:45.902741 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec147f9d-7c04-4719-a1af-56bf820e424e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:45.903432 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec147f9d-7c04-4719-a1af-56bf820e424e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:45.904031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec147f9d-7c04-4719-a1af-56bf820e424e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:46.030325 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ec147f9d-7c04-4719-a1af-56bf820e424e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:46.037639 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ec147f9d-7c04-4719-a1af-56bf820e424e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.150190 Aug 05 02:22:46.038234 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 210/419] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:45 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:46.408798 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7d8e3b2c-7e29-42ea-b7bf-6561fb7252b0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:46.409397 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7d8e3b2c-7e29-42ea-b7bf-6561fb7252b0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:46.416315 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7d8e3b2c-7e29-42ea-b7bf-6561fb7252b0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:46.416976 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7d8e3b2c-7e29-42ea-b7bf-6561fb7252b0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:46.417403 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7d8e3b2c-7e29-42ea-b7bf-6561fb7252b0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:46.418078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7d8e3b2c-7e29-42ea-b7bf-6561fb7252b0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:46.418522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7d8e3b2c-7e29-42ea-b7bf-6561fb7252b0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:46.418937 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7d8e3b2c-7e29-42ea-b7bf-6561fb7252b0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:46.550269 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7d8e3b2c-7e29-42ea-b7bf-6561fb7252b0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:46.558455 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7d8e3b2c-7e29-42ea-b7bf-6561fb7252b0 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.153376 Aug 05 02:22:46.558928 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 210/420] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:46 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:46.646676 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2a44fc47-8a8c-4e6e-b584-d4d4b880755c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:46.646676 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2a44fc47-8a8c-4e6e-b584-d4d4b880755c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:46.649885 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a44fc47-8a8c-4e6e-b584-d4d4b880755c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:46.652274 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a44fc47-8a8c-4e6e-b584-d4d4b880755c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:46.652756 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a44fc47-8a8c-4e6e-b584-d4d4b880755c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:46.653471 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a44fc47-8a8c-4e6e-b584-d4d4b880755c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:46.653932 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a44fc47-8a8c-4e6e-b584-d4d4b880755c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:46.654445 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a44fc47-8a8c-4e6e-b584-d4d4b880755c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:46.686244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a44fc47-8a8c-4e6e-b584-d4d4b880755c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:46.686731 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a44fc47-8a8c-4e6e-b584-d4d4b880755c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:46.687167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a44fc47-8a8c-4e6e-b584-d4d4b880755c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:46.687609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-2a44fc47-8a8c-4e6e-b584-d4d4b880755c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lazy-loading 'fault' on Instance uuid 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:22:46.733675 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2a44fc47-8a8c-4e6e-b584-d4d4b880755c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:46.741871 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2a44fc47-8a8c-4e6e-b584-d4d4b880755c tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1351 microversion: 2.1 time: 0.104219 Aug 05 02:22:46.742732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 211/421] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:46 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:46.816642 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-04b979db-2205-49ad-bbc9-6e3b3bb723d9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:46.817277 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-04b979db-2205-49ad-bbc9-6e3b3bb723d9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:46.823977 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04b979db-2205-49ad-bbc9-6e3b3bb723d9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:46.824916 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04b979db-2205-49ad-bbc9-6e3b3bb723d9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:46.825359 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04b979db-2205-49ad-bbc9-6e3b3bb723d9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:46.826075 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04b979db-2205-49ad-bbc9-6e3b3bb723d9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:46.826518 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04b979db-2205-49ad-bbc9-6e3b3bb723d9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:46.826929 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04b979db-2205-49ad-bbc9-6e3b3bb723d9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:46.964071 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-04b979db-2205-49ad-bbc9-6e3b3bb723d9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:46.971629 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-04b979db-2205-49ad-bbc9-6e3b3bb723d9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.158883 Aug 05 02:22:46.972198 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 211/422] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:46 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:47.060348 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-90acb0f2-c95f-45b8-98dc-d9ea3226519d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:47.060971 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-90acb0f2-c95f-45b8-98dc-d9ea3226519d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:47.067012 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90acb0f2-c95f-45b8-98dc-d9ea3226519d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:47.067525 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90acb0f2-c95f-45b8-98dc-d9ea3226519d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:47.068044 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90acb0f2-c95f-45b8-98dc-d9ea3226519d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:47.068797 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90acb0f2-c95f-45b8-98dc-d9ea3226519d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:47.069238 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90acb0f2-c95f-45b8-98dc-d9ea3226519d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:47.069660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90acb0f2-c95f-45b8-98dc-d9ea3226519d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:47.202278 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-90acb0f2-c95f-45b8-98dc-d9ea3226519d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:47.209613 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-90acb0f2-c95f-45b8-98dc-d9ea3226519d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.154433 Aug 05 02:22:47.210161 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 212/423] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:47 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:47.578889 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-80079608-0956-42ae-a3a8-0120dfa4f94c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:47.579419 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-80079608-0956-42ae-a3a8-0120dfa4f94c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:47.586251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-80079608-0956-42ae-a3a8-0120dfa4f94c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:47.586862 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-80079608-0956-42ae-a3a8-0120dfa4f94c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:47.587894 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-80079608-0956-42ae-a3a8-0120dfa4f94c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:47.588898 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-80079608-0956-42ae-a3a8-0120dfa4f94c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:47.589420 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-80079608-0956-42ae-a3a8-0120dfa4f94c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:47.589848 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-80079608-0956-42ae-a3a8-0120dfa4f94c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:47.727426 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-80079608-0956-42ae-a3a8-0120dfa4f94c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:47.735482 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-80079608-0956-42ae-a3a8-0120dfa4f94c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.160506 Aug 05 02:22:47.736037 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 212/424] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:47 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:47.761786 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7a282b1c-13de-40aa-9691-124f74b6a6f4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:47.762418 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7a282b1c-13de-40aa-9691-124f74b6a6f4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:47.768508 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a282b1c-13de-40aa-9691-124f74b6a6f4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:47.768989 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a282b1c-13de-40aa-9691-124f74b6a6f4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:47.769445 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a282b1c-13de-40aa-9691-124f74b6a6f4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:47.770107 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a282b1c-13de-40aa-9691-124f74b6a6f4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:47.770553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a282b1c-13de-40aa-9691-124f74b6a6f4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:47.770973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a282b1c-13de-40aa-9691-124f74b6a6f4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:47.802102 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a282b1c-13de-40aa-9691-124f74b6a6f4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:47.802572 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a282b1c-13de-40aa-9691-124f74b6a6f4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:47.802996 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7a282b1c-13de-40aa-9691-124f74b6a6f4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:47.803428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-7a282b1c-13de-40aa-9691-124f74b6a6f4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lazy-loading 'fault' on Instance uuid 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:22:47.843650 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7a282b1c-13de-40aa-9691-124f74b6a6f4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:47.851746 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7a282b1c-13de-40aa-9691-124f74b6a6f4 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1351 microversion: 2.1 time: 0.093751 Aug 05 02:22:47.852300 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 213/425] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:47 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:47.992128 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4325307a-7ce0-404e-a585-bbad48d890fe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:47.992755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4325307a-7ce0-404e-a585-bbad48d890fe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:47.998764 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4325307a-7ce0-404e-a585-bbad48d890fe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:47.999232 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4325307a-7ce0-404e-a585-bbad48d890fe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:47.999654 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4325307a-7ce0-404e-a585-bbad48d890fe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:48.000457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4325307a-7ce0-404e-a585-bbad48d890fe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:48.000784 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4325307a-7ce0-404e-a585-bbad48d890fe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:48.001194 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4325307a-7ce0-404e-a585-bbad48d890fe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:48.154364 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4325307a-7ce0-404e-a585-bbad48d890fe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:48.161674 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4325307a-7ce0-404e-a585-bbad48d890fe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.173424 Aug 05 02:22:48.162223 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 213/426] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:47 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:48.230092 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b9c1c628-9f28-4fa6-9807-7e358acf91ea tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:48.230699 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b9c1c628-9f28-4fa6-9807-7e358acf91ea tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:48.236583 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9c1c628-9f28-4fa6-9807-7e358acf91ea tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:48.237062 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9c1c628-9f28-4fa6-9807-7e358acf91ea tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:48.237498 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9c1c628-9f28-4fa6-9807-7e358acf91ea tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:48.238179 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9c1c628-9f28-4fa6-9807-7e358acf91ea tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:48.238629 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9c1c628-9f28-4fa6-9807-7e358acf91ea tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:48.239053 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9c1c628-9f28-4fa6-9807-7e358acf91ea tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:48.366480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b9c1c628-9f28-4fa6-9807-7e358acf91ea tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:48.374256 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b9c1c628-9f28-4fa6-9807-7e358acf91ea tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.147948 Aug 05 02:22:48.374872 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 214/427] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:48 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:48.754945 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8d304915-2598-413b-82be-f0b500ec2ec6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:48.755572 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8d304915-2598-413b-82be-f0b500ec2ec6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:48.761998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d304915-2598-413b-82be-f0b500ec2ec6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:48.762475 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d304915-2598-413b-82be-f0b500ec2ec6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:48.762907 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d304915-2598-413b-82be-f0b500ec2ec6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:48.763588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d304915-2598-413b-82be-f0b500ec2ec6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:48.764043 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d304915-2598-413b-82be-f0b500ec2ec6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:48.764504 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d304915-2598-413b-82be-f0b500ec2ec6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:48.873823 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e8a24434-38ee-449c-ba49-b126313972c6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:48.874509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e8a24434-38ee-449c-ba49-b126313972c6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:48.880348 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a24434-38ee-449c-ba49-b126313972c6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:48.880860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a24434-38ee-449c-ba49-b126313972c6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:48.881296 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a24434-38ee-449c-ba49-b126313972c6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:48.881986 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a24434-38ee-449c-ba49-b126313972c6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:48.882439 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a24434-38ee-449c-ba49-b126313972c6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:48.882882 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a24434-38ee-449c-ba49-b126313972c6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:48.892996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8d304915-2598-413b-82be-f0b500ec2ec6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:48.900483 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8d304915-2598-413b-82be-f0b500ec2ec6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1521 microversion: 2.1 time: 0.149389 Aug 05 02:22:48.901098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 214/428] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:48 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:48.913244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a24434-38ee-449c-ba49-b126313972c6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:48.913727 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a24434-38ee-449c-ba49-b126313972c6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:48.914163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a24434-38ee-449c-ba49-b126313972c6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:48.914600 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-e8a24434-38ee-449c-ba49-b126313972c6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lazy-loading 'fault' on Instance uuid 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:22:48.958368 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e8a24434-38ee-449c-ba49-b126313972c6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:48.966547 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e8a24434-38ee-449c-ba49-b126313972c6 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1351 microversion: 2.1 time: 0.097477 Aug 05 02:22:48.967116 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 215/429] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:48 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:49.182013 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8ecdd170-8448-4491-94fb-af71ac1e8f6e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:49.183861 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8ecdd170-8448-4491-94fb-af71ac1e8f6e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:49.189873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ecdd170-8448-4491-94fb-af71ac1e8f6e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:49.190353 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ecdd170-8448-4491-94fb-af71ac1e8f6e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:49.190781 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ecdd170-8448-4491-94fb-af71ac1e8f6e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:49.191461 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ecdd170-8448-4491-94fb-af71ac1e8f6e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:49.191914 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ecdd170-8448-4491-94fb-af71ac1e8f6e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:49.192353 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ecdd170-8448-4491-94fb-af71ac1e8f6e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:49.334361 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8ecdd170-8448-4491-94fb-af71ac1e8f6e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:49.342837 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8ecdd170-8448-4491-94fb-af71ac1e8f6e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.164458 Aug 05 02:22:49.343384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 215/430] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:49 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:49.395041 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6ba43209-1e0b-4399-a8e0-a657936b31b1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:49.395729 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6ba43209-1e0b-4399-a8e0-a657936b31b1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:49.402193 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ba43209-1e0b-4399-a8e0-a657936b31b1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:49.402754 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ba43209-1e0b-4399-a8e0-a657936b31b1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:49.403189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ba43209-1e0b-4399-a8e0-a657936b31b1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:49.403865 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ba43209-1e0b-4399-a8e0-a657936b31b1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:49.404315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ba43209-1e0b-4399-a8e0-a657936b31b1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:49.404757 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ba43209-1e0b-4399-a8e0-a657936b31b1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:49.540962 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6ba43209-1e0b-4399-a8e0-a657936b31b1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:49.549824 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6ba43209-1e0b-4399-a8e0-a657936b31b1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.158543 Aug 05 02:22:49.550685 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 216/431] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:49 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:49.921283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-10651420-084b-479a-998d-880c86a972ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:49.921894 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-10651420-084b-479a-998d-880c86a972ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:49.928969 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10651420-084b-479a-998d-880c86a972ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:49.929586 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10651420-084b-479a-998d-880c86a972ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:49.930042 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10651420-084b-479a-998d-880c86a972ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:49.930772 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10651420-084b-479a-998d-880c86a972ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:49.931285 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10651420-084b-479a-998d-880c86a972ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:49.932359 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10651420-084b-479a-998d-880c86a972ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:49.988404 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f1abf3a7-510c-44cb-aaef-bb76b75fc516 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:49.989087 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f1abf3a7-510c-44cb-aaef-bb76b75fc516 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:49.996042 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1abf3a7-510c-44cb-aaef-bb76b75fc516 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:49.996774 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1abf3a7-510c-44cb-aaef-bb76b75fc516 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:49.997218 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1abf3a7-510c-44cb-aaef-bb76b75fc516 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:49.997921 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1abf3a7-510c-44cb-aaef-bb76b75fc516 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:49.998542 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1abf3a7-510c-44cb-aaef-bb76b75fc516 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:49.998973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1abf3a7-510c-44cb-aaef-bb76b75fc516 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:50.033365 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1abf3a7-510c-44cb-aaef-bb76b75fc516 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:50.033856 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1abf3a7-510c-44cb-aaef-bb76b75fc516 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:50.034425 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1abf3a7-510c-44cb-aaef-bb76b75fc516 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:50.034890 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-f1abf3a7-510c-44cb-aaef-bb76b75fc516 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lazy-loading 'fault' on Instance uuid 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:22:50.103351 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-10651420-084b-479a-998d-880c86a972ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:50.112218 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-10651420-084b-479a-998d-880c86a972ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1501 microversion: 2.1 time: 0.194864 Aug 05 02:22:50.113329 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 216/432] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:49 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1501 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:50.133149 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f5476a1c-d600-4ac2-9eef-1eab0d20f3e3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:50.133934 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f5476a1c-d600-4ac2-9eef-1eab0d20f3e3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:50.141100 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5476a1c-d600-4ac2-9eef-1eab0d20f3e3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:50.141771 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5476a1c-d600-4ac2-9eef-1eab0d20f3e3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:50.142298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5476a1c-d600-4ac2-9eef-1eab0d20f3e3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:50.143091 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5476a1c-d600-4ac2-9eef-1eab0d20f3e3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:50.143619 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5476a1c-d600-4ac2-9eef-1eab0d20f3e3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:50.144134 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f5476a1c-d600-4ac2-9eef-1eab0d20f3e3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:50.309974 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f1abf3a7-510c-44cb-aaef-bb76b75fc516 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e39a7be17b94c9c9dfb9ac1599a0052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550d9709b98404290936885c7bbb16d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:50.317976 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f1abf3a7-510c-44cb-aaef-bb76b75fc516 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 200 len: 1351 microversion: 2.1 time: 0.333416 Aug 05 02:22:50.319787 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 217/433] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:49 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 1351 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:50.367933 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7922f6df-89c5-4719-8dc7-324ca99a40fa tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:50.368280 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f5476a1c-d600-4ac2-9eef-1eab0d20f3e3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:50.368986 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7922f6df-89c5-4719-8dc7-324ca99a40fa tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:50.377094 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7922f6df-89c5-4719-8dc7-324ca99a40fa tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:50.377771 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7922f6df-89c5-4719-8dc7-324ca99a40fa tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:50.378150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f5476a1c-d600-4ac2-9eef-1eab0d20f3e3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1517 microversion: 2.1 time: 0.248543 Aug 05 02:22:50.378439 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7922f6df-89c5-4719-8dc7-324ca99a40fa tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:50.379619 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 217/434] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:50 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1517 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:50.394777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7922f6df-89c5-4719-8dc7-324ca99a40fa tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:50.397874 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7922f6df-89c5-4719-8dc7-324ca99a40fa tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:50.398366 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7922f6df-89c5-4719-8dc7-324ca99a40fa tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:50.574609 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-999a548a-2c9b-401a-8586-cb69855821f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:50.575858 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-999a548a-2c9b-401a-8586-cb69855821f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:50.584955 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-999a548a-2c9b-401a-8586-cb69855821f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:50.585684 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-999a548a-2c9b-401a-8586-cb69855821f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:50.586360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-999a548a-2c9b-401a-8586-cb69855821f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:50.587420 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-999a548a-2c9b-401a-8586-cb69855821f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:50.588641 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-999a548a-2c9b-401a-8586-cb69855821f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:50.590552 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-999a548a-2c9b-401a-8586-cb69855821f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:50.741232 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7922f6df-89c5-4719-8dc7-324ca99a40fa tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:50.754354 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7922f6df-89c5-4719-8dc7-324ca99a40fa tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.390468 Aug 05 02:22:50.756407 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 218/435] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:50 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:50.763764 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-999a548a-2c9b-401a-8586-cb69855821f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:50.772804 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-999a548a-2c9b-401a-8586-cb69855821f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.205488 Aug 05 02:22:50.784349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 218/436] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:50 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:51.218648 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-8f4be70b-aaaa-4fad-8dda-400afa29393a req-ac29d169-222c-433b-b47a-67fade32dfa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9953aa28-10c7-463e-b2f2-9640f42f9eb0", "name": "network-vif-plugged", "status": "completed", "tag": "dfd12349-70f1-45d4-b28a-ecee9fcd63ab"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:22:51.230755 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8f4be70b-aaaa-4fad-8dda-400afa29393a req-ac29d169-222c-433b-b47a-67fade32dfa8 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:51.231358 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8f4be70b-aaaa-4fad-8dda-400afa29393a req-ac29d169-222c-433b-b47a-67fade32dfa8 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:51.231859 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8f4be70b-aaaa-4fad-8dda-400afa29393a req-ac29d169-222c-433b-b47a-67fade32dfa8 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:51.243795 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-8f4be70b-aaaa-4fad-8dda-400afa29393a req-ac29d169-222c-433b-b47a-67fade32dfa8 service nova] Creating event network-vif-plugged:dfd12349-70f1-45d4-b28a-ecee9fcd63ab for instance 9953aa28-10c7-463e-b2f2-9640f42f9eb0 on hv-cinder-81558 Aug 05 02:22:51.249413 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-8f4be70b-aaaa-4fad-8dda-400afa29393a req-ac29d169-222c-433b-b47a-67fade32dfa8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034860 Aug 05 02:22:51.250236 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 219/437] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:22:51.339125 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-00d1e9ff-b8e2-4c87-b8b4-bb7b34d0e607 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:51.339666 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-00d1e9ff-b8e2-4c87-b8b4-bb7b34d0e607 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:51.346171 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00d1e9ff-b8e2-4c87-b8b4-bb7b34d0e607 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:51.346648 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00d1e9ff-b8e2-4c87-b8b4-bb7b34d0e607 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:51.347148 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00d1e9ff-b8e2-4c87-b8b4-bb7b34d0e607 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:51.347782 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00d1e9ff-b8e2-4c87-b8b4-bb7b34d0e607 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:51.348180 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00d1e9ff-b8e2-4c87-b8b4-bb7b34d0e607 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:51.348626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00d1e9ff-b8e2-4c87-b8b4-bb7b34d0e607 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:51.362282 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-00d1e9ff-b8e2-4c87-b8b4-bb7b34d0e607 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] HTTP exception thrown: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-00d1e9ff-b8e2-4c87-b8b4-bb7b34d0e607 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Request method failure captured: Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 HTTP/1.1 Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5zsVHbch-yAR3sl0g9TcC7mto7EEfUXsp1PferxmT21pf4CEAHau1kd9nTvZ8jg_SNlpOXVHHydXDcMNU2Ef2GRAFnZSE2oix-qCXnVOCAjIXaFfMt8-bfb5eh7bnsGlAFESky5u4eI5t_aubm79IxA4K2LFsHlAAdlpjcIYMhsN4 Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: 5550d9709b98404290936885c7bbb16d Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-DeleteServersTestJSON-1613670497 Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:22:51.366600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:22:51.368023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5550d9709b98404290936885c7bbb16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5550d9709b98404290936885c7bbb16d", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5550d9709b98404290936885c7bbb16d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5550d9709b98404290936885c7bbb16d"}]}] Aug 05 02:22:51.368023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-DeleteServersTestJSON-1613670497 Aug 05 02:22:51.368023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 5550d9709b98404290936885c7bbb16d Aug 05 02:22:51.368023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-DeleteServersTestJSON-1613670497 Aug 05 02:22:51.368023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-DeleteServersTestJSON-1613670497-project Aug 05 02:22:51.368023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:22:51.368023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:22:51.368023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 4e39a7be17b94c9c9dfb9ac1599a0052 Aug 05 02:22:51.368023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-DeleteServersTestJSON-1613670497-project Aug 05 02:22:51.368023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:22:51.368023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:51.368023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': '69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3'} Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:22:51.369755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:51.371588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:22:51.373010 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-00d1e9ff-b8e2-4c87-b8b4-bb7b34d0e607 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Returning 404 to user: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:22:51.373010 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-00d1e9ff-b8e2-4c87-b8b4-bb7b34d0e607 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 404 len: 111 microversion: 2.1 time: 0.033142 Aug 05 02:22:51.373010 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 219/438] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:51 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:22:51.482717 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2ef495bd-9903-4694-b173-8031883516d2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:51.484945 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2ef495bd-9903-4694-b173-8031883516d2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:51.491193 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ef495bd-9903-4694-b173-8031883516d2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:51.491680 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ef495bd-9903-4694-b173-8031883516d2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:51.492144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ef495bd-9903-4694-b173-8031883516d2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:51.492859 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ef495bd-9903-4694-b173-8031883516d2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:51.493313 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ef495bd-9903-4694-b173-8031883516d2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:51.493737 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ef495bd-9903-4694-b173-8031883516d2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:51.506213 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-2ef495bd-9903-4694-b173-8031883516d2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] HTTP exception thrown: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2ef495bd-9903-4694-b173-8031883516d2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Request method failure captured: Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3/os-volume_attachments HTTP/1.1 Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5zsVHbch-yAR3sl0g9TcC7mto7EEfUXsp1PferxmT21pf4CEAHau1kd9nTvZ8jg_SNlpOXVHHydXDcMNU2Ef2GRAFnZSE2oix-qCXnVOCAjIXaFfMt8-bfb5eh7bnsGlAFESky5u4eI5t_aubm79IxA4K2LFsHlAAdlpjcIYMhsN4 Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 5550d9709b98404290936885c7bbb16d Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-DeleteServersTestJSON-1613670497 Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:22:51.511045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:22:51.512551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5550d9709b98404290936885c7bbb16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5550d9709b98404290936885c7bbb16d", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5550d9709b98404290936885c7bbb16d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5550d9709b98404290936885c7bbb16d"}]}] Aug 05 02:22:51.512551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-DeleteServersTestJSON-1613670497 Aug 05 02:22:51.512551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 5550d9709b98404290936885c7bbb16d Aug 05 02:22:51.512551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1613670497 Aug 05 02:22:51.512551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-DeleteServersTestJSON-1613670497-project Aug 05 02:22:51.512551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:22:51.512551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:22:51.512551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 4e39a7be17b94c9c9dfb9ac1599a0052 Aug 05 02:22:51.512551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-DeleteServersTestJSON-1613670497-project Aug 05 02:22:51.512551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:22:51.512551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:51.512551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'server_id': '69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3'} Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:22:51.513334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:51.514625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:22:51.515959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2ef495bd-9903-4694-b173-8031883516d2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Returning 404 to user: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:22:51.515959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2ef495bd-9903-4694-b173-8031883516d2 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034712 Aug 05 02:22:51.515959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 220/439] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:22:51 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:22:51.778661 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-24fed5eb-e098-4c26-9552-8f3cdeefcfc5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:51.779299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-24fed5eb-e098-4c26-9552-8f3cdeefcfc5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:51.785722 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24fed5eb-e098-4c26-9552-8f3cdeefcfc5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:51.786415 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24fed5eb-e098-4c26-9552-8f3cdeefcfc5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:51.787010 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24fed5eb-e098-4c26-9552-8f3cdeefcfc5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:51.787859 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24fed5eb-e098-4c26-9552-8f3cdeefcfc5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:51.788495 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24fed5eb-e098-4c26-9552-8f3cdeefcfc5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:51.788922 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24fed5eb-e098-4c26-9552-8f3cdeefcfc5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:51.799906 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-36a92c79-7c22-4c33-b66d-b6c1c3ebb56d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:51.800545 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-36a92c79-7c22-4c33-b66d-b6c1c3ebb56d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:51.820296 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36a92c79-7c22-4c33-b66d-b6c1c3ebb56d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:51.821702 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36a92c79-7c22-4c33-b66d-b6c1c3ebb56d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:51.824767 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36a92c79-7c22-4c33-b66d-b6c1c3ebb56d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:51.826110 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36a92c79-7c22-4c33-b66d-b6c1c3ebb56d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:51.828289 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36a92c79-7c22-4c33-b66d-b6c1c3ebb56d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:51.829886 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36a92c79-7c22-4c33-b66d-b6c1c3ebb56d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:52.032048 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-36a92c79-7c22-4c33-b66d-b6c1c3ebb56d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:52.040260 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-36a92c79-7c22-4c33-b66d-b6c1c3ebb56d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1358 microversion: 2.1 time: 0.245817 Aug 05 02:22:52.040837 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 221/440] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:51 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:52.046319 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f7d575fb-e485-48f3-abe9-e48d4d7a1f56 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:22:52.048687 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f7d575fb-e485-48f3-abe9-e48d4d7a1f56 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:52.058965 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-24fed5eb-e098-4c26-9552-8f3cdeefcfc5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:52.062773 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f7d575fb-e485-48f3-abe9-e48d4d7a1f56 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:52.063486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f7d575fb-e485-48f3-abe9-e48d4d7a1f56 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:52.064055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f7d575fb-e485-48f3-abe9-e48d4d7a1f56 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:52.064900 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f7d575fb-e485-48f3-abe9-e48d4d7a1f56 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:52.065374 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f7d575fb-e485-48f3-abe9-e48d4d7a1f56 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:52.065801 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f7d575fb-e485-48f3-abe9-e48d4d7a1f56 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:52.069926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:52.074217 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-24fed5eb-e098-4c26-9552-8f3cdeefcfc5 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.299562 Aug 05 02:22:52.075098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 220/441] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:51 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:52.091601 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-f7d575fb-e485-48f3-abe9-e48d4d7a1f56 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lazy-loading 'flavor' on Instance uuid 786487b8-f24e-4034-82da-c95e8efbf4e4 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:22:52.236685 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f7d575fb-e485-48f3-abe9-e48d4d7a1f56 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "POST /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4/action" status: 200 len: 32 microversion: 2.1 time: 0.194048 Aug 05 02:22:52.238169 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 222/442] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Aug 5 02:22:52 2022] POST /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 02:22:52.247906 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cbb30a5b-7b35-4025-b0d9-abee1f44f767 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:52.248570 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cbb30a5b-7b35-4025-b0d9-abee1f44f767 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:52.254321 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbb30a5b-7b35-4025-b0d9-abee1f44f767 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:52.254800 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbb30a5b-7b35-4025-b0d9-abee1f44f767 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:52.255231 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbb30a5b-7b35-4025-b0d9-abee1f44f767 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:52.255911 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbb30a5b-7b35-4025-b0d9-abee1f44f767 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:52.256389 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbb30a5b-7b35-4025-b0d9-abee1f44f767 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:52.256811 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbb30a5b-7b35-4025-b0d9-abee1f44f767 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:52.275724 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:52.391796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cbb30a5b-7b35-4025-b0d9-abee1f44f767 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:52.399997 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cbb30a5b-7b35-4025-b0d9-abee1f44f767 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.156339 Aug 05 02:22:52.400601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 221/443] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:52 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:52.746730 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-58a70966-84c8-4e92-827d-110ba440bbab tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:52.747319 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-58a70966-84c8-4e92-827d-110ba440bbab tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:52.753505 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58a70966-84c8-4e92-827d-110ba440bbab tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:52.753994 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58a70966-84c8-4e92-827d-110ba440bbab tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:52.754535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58a70966-84c8-4e92-827d-110ba440bbab tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:52.755190 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58a70966-84c8-4e92-827d-110ba440bbab tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:52.755647 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58a70966-84c8-4e92-827d-110ba440bbab tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:52.756073 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58a70966-84c8-4e92-827d-110ba440bbab tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:52.769709 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-58a70966-84c8-4e92-827d-110ba440bbab tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] HTTP exception thrown: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-58a70966-84c8-4e92-827d-110ba440bbab tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Request method failure captured: Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 HTTP/1.1 Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5zsVHbch-yAR3sl0g9TcC7mto7EEfUXsp1PferxmT21pf4CEAHau1kd9nTvZ8jg_SNlpOXVHHydXDcMNU2Ef2GRAFnZSE2oix-qCXnVOCAjIXaFfMt8-bfb5eh7bnsGlAFESky5u4eI5t_aubm79IxA4K2LFsHlAAdlpjcIYMhsN4 Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 5550d9709b98404290936885c7bbb16d Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-DeleteServersTestJSON-1613670497 Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:22:52.772024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:22:52.773486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5550d9709b98404290936885c7bbb16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5550d9709b98404290936885c7bbb16d", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5550d9709b98404290936885c7bbb16d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5550d9709b98404290936885c7bbb16d"}]}] Aug 05 02:22:52.773486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-DeleteServersTestJSON-1613670497 Aug 05 02:22:52.773486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 5550d9709b98404290936885c7bbb16d Aug 05 02:22:52.773486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1613670497 Aug 05 02:22:52.773486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-DeleteServersTestJSON-1613670497-project Aug 05 02:22:52.773486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:22:52.773486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:22:52.773486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 4e39a7be17b94c9c9dfb9ac1599a0052 Aug 05 02:22:52.773486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-DeleteServersTestJSON-1613670497-project Aug 05 02:22:52.773486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:22:52.773486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:52.773486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3'} Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:22:52.774248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:52.775566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:22:52.776822 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-58a70966-84c8-4e92-827d-110ba440bbab tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Returning 404 to user: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:22:52.776822 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-58a70966-84c8-4e92-827d-110ba440bbab tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "DELETE /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 404 len: 111 microversion: 2.1 time: 0.031634 Aug 05 02:22:52.776822 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 223/444] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:22:52 2022] DELETE /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:22:52.781852 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7735009a-6866-4785-b27d-1de0545ed3c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:52.782464 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7735009a-6866-4785-b27d-1de0545ed3c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] [instance: 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:52.788663 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7735009a-6866-4785-b27d-1de0545ed3c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:52.789147 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7735009a-6866-4785-b27d-1de0545ed3c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:52.789583 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7735009a-6866-4785-b27d-1de0545ed3c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:52.790277 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7735009a-6866-4785-b27d-1de0545ed3c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:52.790737 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7735009a-6866-4785-b27d-1de0545ed3c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:52.791163 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7735009a-6866-4785-b27d-1de0545ed3c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:52.804440 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-7735009a-6866-4785-b27d-1de0545ed3c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] HTTP exception thrown: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7735009a-6866-4785-b27d-1de0545ed3c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Request method failure captured: Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 HTTP/1.1 Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5zsVHbch-yAR3sl0g9TcC7mto7EEfUXsp1PferxmT21pf4CEAHau1kd9nTvZ8jg_SNlpOXVHHydXDcMNU2Ef2GRAFnZSE2oix-qCXnVOCAjIXaFfMt8-bfb5eh7bnsGlAFESky5u4eI5t_aubm79IxA4K2LFsHlAAdlpjcIYMhsN4 Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: 5550d9709b98404290936885c7bbb16d Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-DeleteServersTestJSON-1613670497 Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:22:52.806081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:22:52.808000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5550d9709b98404290936885c7bbb16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5550d9709b98404290936885c7bbb16d", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5550d9709b98404290936885c7bbb16d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5550d9709b98404290936885c7bbb16d"}]}] Aug 05 02:22:52.808000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-DeleteServersTestJSON-1613670497 Aug 05 02:22:52.808000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 5550d9709b98404290936885c7bbb16d Aug 05 02:22:52.808000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-DeleteServersTestJSON-1613670497 Aug 05 02:22:52.808000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-DeleteServersTestJSON-1613670497-project Aug 05 02:22:52.808000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:22:52.808000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:22:52.808000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 4e39a7be17b94c9c9dfb9ac1599a0052 Aug 05 02:22:52.808000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-DeleteServersTestJSON-1613670497-project Aug 05 02:22:52.808000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:22:52.808000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:52.808000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': '69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3'} Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:22:52.808912 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. Aug 05 02:22:52.810597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:22:52.811563 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7735009a-6866-4785-b27d-1de0545ed3c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] Returning 404 to user: Instance 69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:22:52.811563 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7735009a-6866-4785-b27d-1de0545ed3c3 tempest-DeleteServersTestJSON-1613670497 tempest-DeleteServersTestJSON-1613670497-project] 10.222.0.15 "GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3" status: 404 len: 111 microversion: 2.1 time: 0.029977 Aug 05 02:22:52.811563 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 222/445] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:52 2022] GET /compute/v2.1/servers/69ebf4f6-3b95-4e21-8e89-f08ecbc5a1d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:22:53.064754 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-08b3546b-392c-456e-a0a6-b623bf1c6966 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:53.070584 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-08b3546b-392c-456e-a0a6-b623bf1c6966 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:53.082312 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08b3546b-392c-456e-a0a6-b623bf1c6966 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:53.084015 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08b3546b-392c-456e-a0a6-b623bf1c6966 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:53.084737 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08b3546b-392c-456e-a0a6-b623bf1c6966 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:53.088448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08b3546b-392c-456e-a0a6-b623bf1c6966 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:53.088903 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08b3546b-392c-456e-a0a6-b623bf1c6966 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:53.089366 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08b3546b-392c-456e-a0a6-b623bf1c6966 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:53.095589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b43efde8-6415-4a70-a6e3-9837fe4e1a23 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:53.095974 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b43efde8-6415-4a70-a6e3-9837fe4e1a23 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:53.111777 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b43efde8-6415-4a70-a6e3-9837fe4e1a23 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:53.112270 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b43efde8-6415-4a70-a6e3-9837fe4e1a23 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:53.112726 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b43efde8-6415-4a70-a6e3-9837fe4e1a23 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:53.113417 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b43efde8-6415-4a70-a6e3-9837fe4e1a23 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:53.114076 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b43efde8-6415-4a70-a6e3-9837fe4e1a23 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:53.114849 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b43efde8-6415-4a70-a6e3-9837fe4e1a23 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:53.269651 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-08b3546b-392c-456e-a0a6-b623bf1c6966 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:53.283418 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-08b3546b-392c-456e-a0a6-b623bf1c6966 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1547 microversion: 2.1 time: 0.224877 Aug 05 02:22:53.296373 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 224/446] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:53 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1547 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:53.308098 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5728abd9-8f24-4470-a12b-1605e4cab52d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:53.309541 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5728abd9-8f24-4470-a12b-1605e4cab52d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:53.315918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5728abd9-8f24-4470-a12b-1605e4cab52d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:53.316494 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5728abd9-8f24-4470-a12b-1605e4cab52d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:53.316955 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5728abd9-8f24-4470-a12b-1605e4cab52d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:53.317662 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5728abd9-8f24-4470-a12b-1605e4cab52d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:53.318112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5728abd9-8f24-4470-a12b-1605e4cab52d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:53.318531 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5728abd9-8f24-4470-a12b-1605e4cab52d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:53.499749 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5728abd9-8f24-4470-a12b-1605e4cab52d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:53.507587 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5728abd9-8f24-4470-a12b-1605e4cab52d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1547 microversion: 2.1 time: 0.206093 Aug 05 02:22:53.508386 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 225/447] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:53 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1547 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:53.516314 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cecd5993-53b5-4cf9-8380-c05e8446606f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:53.517042 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cecd5993-53b5-4cf9-8380-c05e8446606f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:53.523676 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cecd5993-53b5-4cf9-8380-c05e8446606f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:53.524447 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cecd5993-53b5-4cf9-8380-c05e8446606f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:53.524945 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cecd5993-53b5-4cf9-8380-c05e8446606f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:53.526826 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cecd5993-53b5-4cf9-8380-c05e8446606f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:53.527492 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cecd5993-53b5-4cf9-8380-c05e8446606f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:53.528184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cecd5993-53b5-4cf9-8380-c05e8446606f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:53.570530 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b43efde8-6415-4a70-a6e3-9837fe4e1a23 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:53.578975 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b43efde8-6415-4a70-a6e3-9837fe4e1a23 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1314 microversion: 2.1 time: 0.487532 Aug 05 02:22:53.588682 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 223/448] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:53 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:53.596176 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-09d75096-2a5b-42ce-bee9-a71a62783f4a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:53.599868 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-09d75096-2a5b-42ce-bee9-a71a62783f4a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:53.600754 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-09d75096-2a5b-42ce-bee9-a71a62783f4a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Searching by: {'deleted': False, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1'} {{(pid=117921) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 05 02:22:53.609091 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09d75096-2a5b-42ce-bee9-a71a62783f4a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:53.609571 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09d75096-2a5b-42ce-bee9-a71a62783f4a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:53.609999 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09d75096-2a5b-42ce-bee9-a71a62783f4a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:53.610892 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09d75096-2a5b-42ce-bee9-a71a62783f4a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:53.611355 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09d75096-2a5b-42ce-bee9-a71a62783f4a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:53.611780 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09d75096-2a5b-42ce-bee9-a71a62783f4a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:53.705547 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.multi_cell_list [None req-09d75096-2a5b-42ce-bee9-a71a62783f4a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117921) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 05 02:22:53.765474 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cecd5993-53b5-4cf9-8380-c05e8446606f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:53.777458 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cecd5993-53b5-4cf9-8380-c05e8446606f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.267681 Aug 05 02:22:53.778667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 226/449] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:53 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:53.817371 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-09d75096-2a5b-42ce-bee9-a71a62783f4a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.236600 Aug 05 02:22:53.817954 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 224/450] 10.222.0.15 () {58 vars in 1125 bytes} [Fri Aug 5 02:22:53 2022] GET /compute/v2.1/servers => generated 342 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:22:53.830147 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1cc69f32-54cf-45c5-853b-97767426ea34 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:53.830996 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1cc69f32-54cf-45c5-853b-97767426ea34 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:53.840538 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cc69f32-54cf-45c5-853b-97767426ea34 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:53.841413 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cc69f32-54cf-45c5-853b-97767426ea34 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:53.842546 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cc69f32-54cf-45c5-853b-97767426ea34 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:53.844070 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cc69f32-54cf-45c5-853b-97767426ea34 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:53.845351 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cc69f32-54cf-45c5-853b-97767426ea34 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:53.846300 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cc69f32-54cf-45c5-853b-97767426ea34 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:54.074796 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1cc69f32-54cf-45c5-853b-97767426ea34 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:54.088860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1cc69f32-54cf-45c5-853b-97767426ea34 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1547 microversion: 2.1 time: 0.261794 Aug 05 02:22:54.090575 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 227/451] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:53 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1547 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:54.605300 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ce611474-d5f8-4312-80e6-a5f363395034 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:54.606514 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ce611474-d5f8-4312-80e6-a5f363395034 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:54.616159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ce611474-d5f8-4312-80e6-a5f363395034 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:54.617290 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ce611474-d5f8-4312-80e6-a5f363395034 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:54.618073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ce611474-d5f8-4312-80e6-a5f363395034 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:54.619069 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ce611474-d5f8-4312-80e6-a5f363395034 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:54.620058 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ce611474-d5f8-4312-80e6-a5f363395034 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:54.621079 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ce611474-d5f8-4312-80e6-a5f363395034 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:54.798211 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d41fc913-4686-4465-9b54-fe2b8344ce2f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:54.799446 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d41fc913-4686-4465-9b54-fe2b8344ce2f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:54.806150 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d41fc913-4686-4465-9b54-fe2b8344ce2f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:54.806628 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d41fc913-4686-4465-9b54-fe2b8344ce2f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:54.807285 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d41fc913-4686-4465-9b54-fe2b8344ce2f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:54.808164 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d41fc913-4686-4465-9b54-fe2b8344ce2f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:54.808641 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d41fc913-4686-4465-9b54-fe2b8344ce2f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:54.809053 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d41fc913-4686-4465-9b54-fe2b8344ce2f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:54.861237 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ce611474-d5f8-4312-80e6-a5f363395034 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:54.871656 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ce611474-d5f8-4312-80e6-a5f363395034 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1498 microversion: 2.1 time: 0.271747 Aug 05 02:22:54.873029 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 225/452] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:54 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1498 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:54.999427 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d41fc913-4686-4465-9b54-fe2b8344ce2f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:55.007006 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d41fc913-4686-4465-9b54-fe2b8344ce2f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.213018 Aug 05 02:22:55.007978 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 228/453] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:54 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:22:55.742677 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bf83c725-30b3-4e31-8873-2f404c755e6c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:55.743195 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bf83c725-30b3-4e31-8873-2f404c755e6c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:55.758141 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf83c725-30b3-4e31-8873-2f404c755e6c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:55.759020 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf83c725-30b3-4e31-8873-2f404c755e6c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:55.759526 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf83c725-30b3-4e31-8873-2f404c755e6c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:55.760534 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf83c725-30b3-4e31-8873-2f404c755e6c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:55.763680 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf83c725-30b3-4e31-8873-2f404c755e6c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:55.764190 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf83c725-30b3-4e31-8873-2f404c755e6c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:55.817758 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bf83c725-30b3-4e31-8873-2f404c755e6c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:22:55.869507 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e503d30d-06e0-4467-b3d5-6bd13ca759bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b41cafa0-942c-46c8-8a63-8abfb127c16e"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:22:55.873780 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e503d30d-06e0-4467-b3d5-6bd13ca759bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:55.880874 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e503d30d-06e0-4467-b3d5-6bd13ca759bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:55.881605 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e503d30d-06e0-4467-b3d5-6bd13ca759bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:55.882422 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e503d30d-06e0-4467-b3d5-6bd13ca759bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:55.883390 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e503d30d-06e0-4467-b3d5-6bd13ca759bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:55.884453 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e503d30d-06e0-4467-b3d5-6bd13ca759bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:55.885613 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e503d30d-06e0-4467-b3d5-6bd13ca759bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:56.014054 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bf83c725-30b3-4e31-8873-2f404c755e6c tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 204 len: 0 microversion: 2.1 time: 0.275867 Aug 05 02:22:56.028129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 226/454] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:22:55 2022] DELETE /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:22:56.051065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-37b4f0a2-ed1b-4264-8ac0-72f6b5eeb6a2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:56.054103 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-37b4f0a2-ed1b-4264-8ac0-72f6b5eeb6a2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:56.063813 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-37b4f0a2-ed1b-4264-8ac0-72f6b5eeb6a2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:56.065015 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-37b4f0a2-ed1b-4264-8ac0-72f6b5eeb6a2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:56.066955 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-37b4f0a2-ed1b-4264-8ac0-72f6b5eeb6a2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:56.068575 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-37b4f0a2-ed1b-4264-8ac0-72f6b5eeb6a2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:56.069055 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-37b4f0a2-ed1b-4264-8ac0-72f6b5eeb6a2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:56.069571 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-37b4f0a2-ed1b-4264-8ac0-72f6b5eeb6a2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:56.258584 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-37b4f0a2-ed1b-4264-8ac0-72f6b5eeb6a2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:56.266914 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-37b4f0a2-ed1b-4264-8ac0-72f6b5eeb6a2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.237430 Aug 05 02:22:56.267475 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 227/455] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:56 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:56.272848 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2dc57608-0fa0-440e-8007-92152369cf9b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:56.273697 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2dc57608-0fa0-440e-8007-92152369cf9b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:56.283235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2dc57608-0fa0-440e-8007-92152369cf9b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:56.283882 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2dc57608-0fa0-440e-8007-92152369cf9b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:56.284312 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2dc57608-0fa0-440e-8007-92152369cf9b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:56.285061 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2dc57608-0fa0-440e-8007-92152369cf9b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:56.285502 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2dc57608-0fa0-440e-8007-92152369cf9b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:56.285916 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2dc57608-0fa0-440e-8007-92152369cf9b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:56.458248 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2dc57608-0fa0-440e-8007-92152369cf9b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:56.475396 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2dc57608-0fa0-440e-8007-92152369cf9b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1504 microversion: 2.1 time: 0.206208 Aug 05 02:22:56.476113 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 228/456] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:56 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:57.293430 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4ac155e8-5286-43d8-9560-a600b1a295bc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:57.294668 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4ac155e8-5286-43d8-9560-a600b1a295bc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:57.301126 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ac155e8-5286-43d8-9560-a600b1a295bc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:57.301795 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ac155e8-5286-43d8-9560-a600b1a295bc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:57.302238 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ac155e8-5286-43d8-9560-a600b1a295bc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:57.302932 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ac155e8-5286-43d8-9560-a600b1a295bc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:57.303382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ac155e8-5286-43d8-9560-a600b1a295bc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:57.304003 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ac155e8-5286-43d8-9560-a600b1a295bc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:57.668695 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4ac155e8-5286-43d8-9560-a600b1a295bc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:57.676706 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4ac155e8-5286-43d8-9560-a600b1a295bc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.391952 Aug 05 02:22:57.677295 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 229/457] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:57 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:57.682007 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b5deadd1-3f98-4b54-9ecc-7123fb2a982b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:57.682781 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b5deadd1-3f98-4b54-9ecc-7123fb2a982b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:57.689501 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b5deadd1-3f98-4b54-9ecc-7123fb2a982b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:57.690211 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b5deadd1-3f98-4b54-9ecc-7123fb2a982b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:57.690984 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b5deadd1-3f98-4b54-9ecc-7123fb2a982b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:57.691833 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b5deadd1-3f98-4b54-9ecc-7123fb2a982b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:57.692492 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b5deadd1-3f98-4b54-9ecc-7123fb2a982b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:57.693063 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b5deadd1-3f98-4b54-9ecc-7123fb2a982b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:57.879581 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b5deadd1-3f98-4b54-9ecc-7123fb2a982b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:57.890824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b5deadd1-3f98-4b54-9ecc-7123fb2a982b tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1504 microversion: 2.1 time: 0.212247 Aug 05 02:22:57.891856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 230/458] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:57 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:57.893682 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e503d30d-06e0-4467-b3d5-6bd13ca759bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "POST /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.027744 Aug 05 02:22:57.896122 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 229/459] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Aug 5 02:22:55 2022] POST /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments => generated 194 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:22:58.701909 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4ef4d12f-925a-4252-b523-eda93a091c98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:58.702901 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4ef4d12f-925a-4252-b523-eda93a091c98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:58.713066 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef4d12f-925a-4252-b523-eda93a091c98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:58.713951 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef4d12f-925a-4252-b523-eda93a091c98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:58.714548 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef4d12f-925a-4252-b523-eda93a091c98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:58.715940 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef4d12f-925a-4252-b523-eda93a091c98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:58.716579 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef4d12f-925a-4252-b523-eda93a091c98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:58.717818 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef4d12f-925a-4252-b523-eda93a091c98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:58.914390 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d325a129-5788-4867-af0e-f6d004f5ebbe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:22:58.915294 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d325a129-5788-4867-af0e-f6d004f5ebbe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:22:58.923361 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d325a129-5788-4867-af0e-f6d004f5ebbe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:58.924314 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d325a129-5788-4867-af0e-f6d004f5ebbe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:58.924987 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d325a129-5788-4867-af0e-f6d004f5ebbe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:58.925929 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d325a129-5788-4867-af0e-f6d004f5ebbe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:58.927323 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d325a129-5788-4867-af0e-f6d004f5ebbe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:58.928116 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d325a129-5788-4867-af0e-f6d004f5ebbe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:58.959871 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4ef4d12f-925a-4252-b523-eda93a091c98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:58.969616 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4ef4d12f-925a-4252-b523-eda93a091c98 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.272954 Aug 05 02:22:58.970332 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 231/460] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:58 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:22:58.975027 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-fbaa84aa-8576-41a1-a706-d429d50e548b req-627a33d8-1cfb-4f02-8eb2-ade7a159f5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9953aa28-10c7-463e-b2f2-9640f42f9eb0", "name": "network-vif-deleted", "tag": "dfd12349-70f1-45d4-b28a-ecee9fcd63ab"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:22:58.986072 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-fbaa84aa-8576-41a1-a706-d429d50e548b req-627a33d8-1cfb-4f02-8eb2-ade7a159f5a8 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:22:58.986806 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-fbaa84aa-8576-41a1-a706-d429d50e548b req-627a33d8-1cfb-4f02-8eb2-ade7a159f5a8 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:22:58.987227 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-fbaa84aa-8576-41a1-a706-d429d50e548b req-627a33d8-1cfb-4f02-8eb2-ade7a159f5a8 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:22:59.003704 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-fbaa84aa-8576-41a1-a706-d429d50e548b req-627a33d8-1cfb-4f02-8eb2-ade7a159f5a8 service nova] Creating event network-vif-deleted:dfd12349-70f1-45d4-b28a-ecee9fcd63ab for instance 9953aa28-10c7-463e-b2f2-9640f42f9eb0 on hv-cinder-81558 Aug 05 02:22:59.009950 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-fbaa84aa-8576-41a1-a706-d429d50e548b req-627a33d8-1cfb-4f02-8eb2-ade7a159f5a8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038245 Aug 05 02:22:59.011100 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 232/461] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:22:59.020309 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d325a129-5788-4867-af0e-f6d004f5ebbe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:22:59.029462 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d325a129-5788-4867-af0e-f6d004f5ebbe tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 200 len: 1462 microversion: 2.1 time: 0.119870 Aug 05 02:22:59.030609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 230/462] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:58 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 1462 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:23:00.000854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f16609a0-6d57-406e-9e48-10e5c15852b8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:00.004006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f16609a0-6d57-406e-9e48-10e5c15852b8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:00.013017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f16609a0-6d57-406e-9e48-10e5c15852b8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:00.013941 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f16609a0-6d57-406e-9e48-10e5c15852b8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:00.016005 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f16609a0-6d57-406e-9e48-10e5c15852b8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:00.018332 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f16609a0-6d57-406e-9e48-10e5c15852b8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:00.018970 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f16609a0-6d57-406e-9e48-10e5c15852b8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:00.019590 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f16609a0-6d57-406e-9e48-10e5c15852b8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:00.051491 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-26c7256a-a40b-4a16-a4de-a2e741e46672 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:00.052191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-26c7256a-a40b-4a16-a4de-a2e741e46672 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 9953aa28-10c7-463e-b2f2-9640f42f9eb0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:00.059493 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26c7256a-a40b-4a16-a4de-a2e741e46672 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:00.059977 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26c7256a-a40b-4a16-a4de-a2e741e46672 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:00.060628 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26c7256a-a40b-4a16-a4de-a2e741e46672 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:00.061333 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26c7256a-a40b-4a16-a4de-a2e741e46672 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:00.061788 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26c7256a-a40b-4a16-a4de-a2e741e46672 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:00.062390 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26c7256a-a40b-4a16-a4de-a2e741e46672 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:00.076615 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-26c7256a-a40b-4a16-a4de-a2e741e46672 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] HTTP exception thrown: Instance 9953aa28-10c7-463e-b2f2-9640f42f9eb0 could not be found. Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-26c7256a-a40b-4a16-a4de-a2e741e46672 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Request method failure captured: Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 HTTP/1.1 Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H7NdkH25qsPQRNupbVCKJg8iozQcU1cCjlNUgEKQjlAiawLln5kE4tnCQO1SvqAc9D9JR8empFoJlXZj9ZTeyG9OKtlnrhnjQPHh8Ebv0cmMFSQgVcy7Sbz2qvCkiQibj4Ix5orDKJ4T9_lHaD9g6qzSxegL2dMDsxM9sfbKBeBsE8 Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 14962cc915f647cc916994ec724de454 Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesActionsTest-1350616301 Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:23:00.078470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:23:00.080050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/14962cc915f647cc916994ec724de454"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_14962cc915f647cc916994ec724de454", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/14962cc915f647cc916994ec724de454"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/14962cc915f647cc916994ec724de454"}]}] Aug 05 02:23:00.080050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesActionsTest-1350616301 Aug 05 02:23:00.080050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 14962cc915f647cc916994ec724de454 Aug 05 02:23:00.080050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesActionsTest-1350616301 Aug 05 02:23:00.080050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesActionsTest-1350616301-project Aug 05 02:23:00.080050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:23:00.080050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:23:00.080050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 47d90567551e4cfb9bcc974e11d4e42c Aug 05 02:23:00.080050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesActionsTest-1350616301-project Aug 05 02:23:00.080050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:23:00.080050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 9953aa28-10c7-463e-b2f2-9640f42f9eb0 could not be found. Aug 05 02:23:00.080050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '9953aa28-10c7-463e-b2f2-9640f42f9eb0'} Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9953aa28-10c7-463e-b2f2-9640f42f9eb0 could not be found. Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:23:00.080915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9953aa28-10c7-463e-b2f2-9640f42f9eb0 could not be found. Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9953aa28-10c7-463e-b2f2-9640f42f9eb0 could not be found. Aug 05 02:23:00.082315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:23:00.083468 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-26c7256a-a40b-4a16-a4de-a2e741e46672 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Returning 404 to user: Instance 9953aa28-10c7-463e-b2f2-9640f42f9eb0 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:23:00.083468 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-26c7256a-a40b-4a16-a4de-a2e741e46672 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0" status: 404 len: 111 microversion: 2.1 time: 0.032504 Aug 05 02:23:00.083468 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 231/463] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:00 2022] GET /compute/v2.1/servers/9953aa28-10c7-463e-b2f2-9640f42f9eb0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:23:00.193582 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f16609a0-6d57-406e-9e48-10e5c15852b8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:00.204165 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f16609a0-6d57-406e-9e48-10e5c15852b8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.214606 Aug 05 02:23:00.204704 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 233/464] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:22:59 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:23:00.205791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-839983699", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452", "networks": [{"uuid": "7e162cf4-1761-488b-a0c2-fc8d03640ad2"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:23:00.260595 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] validate_networks() for [('7e162cf4-1761-488b-a0c2-fc8d03640ad2', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:23:00.629680 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:23:00.630164 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:23:00.630699 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:23:00.631166 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:23:00.631636 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:23:00.641251 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:00.641793 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:00.642287 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:00.643193 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:00.643702 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:00.644182 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:00.661482 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Getting quotas for project 14962cc915f647cc916994ec724de454. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:23:00.666260 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Getting quotas for user 47d90567551e4cfb9bcc974e11d4e42c and project 14962cc915f647cc916994ec724de454. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:23:00.677531 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:23:00.679780 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:23:00.725406 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bb2316f1-242b-4f50-acf3-e568b51bade0 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523310 Aug 05 02:23:00.726154 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 232/465] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:23:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 05 02:23:00.737140 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f8ec0408-63d8-4944-9c43-d3c5796b76fd tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:00.737746 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f8ec0408-63d8-4944-9c43-d3c5796b76fd tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:00.796733 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f8ec0408-63d8-4944-9c43-d3c5796b76fd tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:00.803603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f8ec0408-63d8-4944-9c43-d3c5796b76fd tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1213 microversion: 2.1 time: 0.070163 Aug 05 02:23:00.804533 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 234/466] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:00 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:01.226571 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1a94e110-7ad3-4b25-b21d-8b884e96dcc1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:01.227783 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1a94e110-7ad3-4b25-b21d-8b884e96dcc1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:01.237778 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a94e110-7ad3-4b25-b21d-8b884e96dcc1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:01.239208 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a94e110-7ad3-4b25-b21d-8b884e96dcc1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:01.240071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a94e110-7ad3-4b25-b21d-8b884e96dcc1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:01.243326 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a94e110-7ad3-4b25-b21d-8b884e96dcc1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:01.244434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a94e110-7ad3-4b25-b21d-8b884e96dcc1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:01.248827 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a94e110-7ad3-4b25-b21d-8b884e96dcc1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:01.427441 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1a94e110-7ad3-4b25-b21d-8b884e96dcc1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:01.436159 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1a94e110-7ad3-4b25-b21d-8b884e96dcc1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.213784 Aug 05 02:23:01.436987 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 233/467] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:01 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:01.825325 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2677d033-e108-479f-91c6-3f97fcd27843 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:01.825940 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2677d033-e108-479f-91c6-3f97fcd27843 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:01.832698 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2677d033-e108-479f-91c6-3f97fcd27843 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:01.833116 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2677d033-e108-479f-91c6-3f97fcd27843 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:01.833607 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2677d033-e108-479f-91c6-3f97fcd27843 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:01.834517 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2677d033-e108-479f-91c6-3f97fcd27843 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:01.834924 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2677d033-e108-479f-91c6-3f97fcd27843 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:01.835346 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2677d033-e108-479f-91c6-3f97fcd27843 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:01.915567 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2677d033-e108-479f-91c6-3f97fcd27843 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:01.923310 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2677d033-e108-479f-91c6-3f97fcd27843 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1265 microversion: 2.1 time: 0.102518 Aug 05 02:23:01.924050 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 235/468] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:01 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:02.457777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-63750c0f-0f73-4a60-957d-a1300d88141d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:02.459113 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-63750c0f-0f73-4a60-957d-a1300d88141d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:02.467331 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63750c0f-0f73-4a60-957d-a1300d88141d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:02.468188 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63750c0f-0f73-4a60-957d-a1300d88141d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:02.468899 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63750c0f-0f73-4a60-957d-a1300d88141d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:02.470107 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63750c0f-0f73-4a60-957d-a1300d88141d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:02.470838 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63750c0f-0f73-4a60-957d-a1300d88141d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:02.471429 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63750c0f-0f73-4a60-957d-a1300d88141d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:02.620522 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-63750c0f-0f73-4a60-957d-a1300d88141d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:02.629214 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-63750c0f-0f73-4a60-957d-a1300d88141d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.175555 Aug 05 02:23:02.630444 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 234/469] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:02 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:02.944862 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-58e4d340-5abe-406d-86c3-44ea1a2b17ec tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:02.945637 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-58e4d340-5abe-406d-86c3-44ea1a2b17ec tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:02.952962 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58e4d340-5abe-406d-86c3-44ea1a2b17ec tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:02.953474 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58e4d340-5abe-406d-86c3-44ea1a2b17ec tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:02.953936 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58e4d340-5abe-406d-86c3-44ea1a2b17ec tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:02.954629 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58e4d340-5abe-406d-86c3-44ea1a2b17ec tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:02.955088 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58e4d340-5abe-406d-86c3-44ea1a2b17ec tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:02.955511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58e4d340-5abe-406d-86c3-44ea1a2b17ec tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:03.143328 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-58e4d340-5abe-406d-86c3-44ea1a2b17ec tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:03.151352 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-58e4d340-5abe-406d-86c3-44ea1a2b17ec tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1313 microversion: 2.1 time: 0.210338 Aug 05 02:23:03.151913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 236/470] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:02 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:03.394323 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-46c61b27-0a2e-4543-ae6e-9d292180aade req-1a177dde-01d3-4865-a9d1-af4c9018bb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "865edaf2-33cf-496d-a052-35aa26d85c59", "tag": "25ab673e-d0f2-4f57-ab69-0df7d17ddc78"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:23:03.404833 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-46c61b27-0a2e-4543-ae6e-9d292180aade req-1a177dde-01d3-4865-a9d1-af4c9018bb99 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:03.405309 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-46c61b27-0a2e-4543-ae6e-9d292180aade req-1a177dde-01d3-4865-a9d1-af4c9018bb99 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:03.405730 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-46c61b27-0a2e-4543-ae6e-9d292180aade req-1a177dde-01d3-4865-a9d1-af4c9018bb99 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:03.425811 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-46c61b27-0a2e-4543-ae6e-9d292180aade req-1a177dde-01d3-4865-a9d1-af4c9018bb99 service nova] Creating event network-changed:25ab673e-d0f2-4f57-ab69-0df7d17ddc78 for instance 865edaf2-33cf-496d-a052-35aa26d85c59 on hv-cinder-81558 Aug 05 02:23:03.430873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-46c61b27-0a2e-4543-ae6e-9d292180aade req-1a177dde-01d3-4865-a9d1-af4c9018bb99 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040068 Aug 05 02:23:03.431956 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 235/471] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:23:03.651470 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5ef162c2-f763-4cf7-864a-94326103eec3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:03.652007 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5ef162c2-f763-4cf7-864a-94326103eec3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:03.653961 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:03.659164 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ef162c2-f763-4cf7-864a-94326103eec3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:03.659643 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ef162c2-f763-4cf7-864a-94326103eec3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:03.660077 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ef162c2-f763-4cf7-864a-94326103eec3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:03.660795 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ef162c2-f763-4cf7-864a-94326103eec3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:03.661243 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ef162c2-f763-4cf7-864a-94326103eec3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:03.661661 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ef162c2-f763-4cf7-864a-94326103eec3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:03.874687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5ef162c2-f763-4cf7-864a-94326103eec3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:03.882153 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5ef162c2-f763-4cf7-864a-94326103eec3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.235071 Aug 05 02:23:03.882722 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 237/472] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:03 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:04.173069 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-adef6a4e-3226-4e9f-a44d-50edfadf16b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:04.173760 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-adef6a4e-3226-4e9f-a44d-50edfadf16b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:04.179702 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adef6a4e-3226-4e9f-a44d-50edfadf16b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:04.180187 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adef6a4e-3226-4e9f-a44d-50edfadf16b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:04.180655 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adef6a4e-3226-4e9f-a44d-50edfadf16b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:04.182533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adef6a4e-3226-4e9f-a44d-50edfadf16b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:04.182994 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adef6a4e-3226-4e9f-a44d-50edfadf16b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:04.183422 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adef6a4e-3226-4e9f-a44d-50edfadf16b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:04.318503 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-adef6a4e-3226-4e9f-a44d-50edfadf16b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:04.326822 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-adef6a4e-3226-4e9f-a44d-50edfadf16b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1313 microversion: 2.1 time: 0.158299 Aug 05 02:23:04.327380 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 236/473] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:04 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:04.903487 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-15937eca-a94b-4c3f-87a5-47201d26438f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:04.904131 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-15937eca-a94b-4c3f-87a5-47201d26438f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:04.910433 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15937eca-a94b-4c3f-87a5-47201d26438f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:04.910921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15937eca-a94b-4c3f-87a5-47201d26438f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:04.911356 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15937eca-a94b-4c3f-87a5-47201d26438f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:04.912039 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15937eca-a94b-4c3f-87a5-47201d26438f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:04.912517 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15937eca-a94b-4c3f-87a5-47201d26438f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:04.912939 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15937eca-a94b-4c3f-87a5-47201d26438f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:04.930985 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:05.044193 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-15937eca-a94b-4c3f-87a5-47201d26438f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:05.055261 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-15937eca-a94b-4c3f-87a5-47201d26438f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.156157 Aug 05 02:23:05.056088 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 238/474] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:04 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:05.347762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-25ad4449-a5ce-40e4-9c0d-1ce6c52033be tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:05.348857 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-25ad4449-a5ce-40e4-9c0d-1ce6c52033be tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:05.358241 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-25ad4449-a5ce-40e4-9c0d-1ce6c52033be tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:05.358713 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-25ad4449-a5ce-40e4-9c0d-1ce6c52033be tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:05.359150 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-25ad4449-a5ce-40e4-9c0d-1ce6c52033be tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:05.359848 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-25ad4449-a5ce-40e4-9c0d-1ce6c52033be tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:05.360299 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-25ad4449-a5ce-40e4-9c0d-1ce6c52033be tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:05.360751 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-25ad4449-a5ce-40e4-9c0d-1ce6c52033be tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:05.502233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-25ad4449-a5ce-40e4-9c0d-1ce6c52033be tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:05.510992 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-25ad4449-a5ce-40e4-9c0d-1ce6c52033be tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1313 microversion: 2.1 time: 0.166957 Aug 05 02:23:05.511558 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 237/475] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:05 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:06.076727 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-510d0b45-ee7b-477e-94f6-1597a50cfbc3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:06.077333 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-510d0b45-ee7b-477e-94f6-1597a50cfbc3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:06.083648 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-510d0b45-ee7b-477e-94f6-1597a50cfbc3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:06.084125 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-510d0b45-ee7b-477e-94f6-1597a50cfbc3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:06.084593 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-510d0b45-ee7b-477e-94f6-1597a50cfbc3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:06.085274 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-510d0b45-ee7b-477e-94f6-1597a50cfbc3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:06.085728 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-510d0b45-ee7b-477e-94f6-1597a50cfbc3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:06.086147 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-510d0b45-ee7b-477e-94f6-1597a50cfbc3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:06.217109 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-510d0b45-ee7b-477e-94f6-1597a50cfbc3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:06.224801 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-510d0b45-ee7b-477e-94f6-1597a50cfbc3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.152457 Aug 05 02:23:06.225370 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 239/476] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:06 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:06.531817 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2fa2c9ad-24b8-41d3-99ac-f62deaaa3336 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:06.532468 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2fa2c9ad-24b8-41d3-99ac-f62deaaa3336 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:06.538892 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fa2c9ad-24b8-41d3-99ac-f62deaaa3336 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:06.539370 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fa2c9ad-24b8-41d3-99ac-f62deaaa3336 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:06.539798 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fa2c9ad-24b8-41d3-99ac-f62deaaa3336 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:06.540515 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fa2c9ad-24b8-41d3-99ac-f62deaaa3336 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:06.540963 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fa2c9ad-24b8-41d3-99ac-f62deaaa3336 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:06.541378 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2fa2c9ad-24b8-41d3-99ac-f62deaaa3336 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:06.545709 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:06.711893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2fa2c9ad-24b8-41d3-99ac-f62deaaa3336 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:06.720430 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2fa2c9ad-24b8-41d3-99ac-f62deaaa3336 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1313 microversion: 2.1 time: 0.192306 Aug 05 02:23:06.720995 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 238/477] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:06 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:07.246202 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-529992a8-9827-4ab7-b813-b99c888183d2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:07.246948 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-529992a8-9827-4ab7-b813-b99c888183d2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:07.253483 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-529992a8-9827-4ab7-b813-b99c888183d2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:07.253964 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-529992a8-9827-4ab7-b813-b99c888183d2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:07.254394 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-529992a8-9827-4ab7-b813-b99c888183d2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:07.255096 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-529992a8-9827-4ab7-b813-b99c888183d2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:07.255538 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-529992a8-9827-4ab7-b813-b99c888183d2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:07.255951 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-529992a8-9827-4ab7-b813-b99c888183d2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:07.478771 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-529992a8-9827-4ab7-b813-b99c888183d2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:07.486865 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-529992a8-9827-4ab7-b813-b99c888183d2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.244921 Aug 05 02:23:07.487425 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 240/478] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:07 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:07.742242 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4b4acab2-c5d8-413e-8051-18917236dd40 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:07.742862 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4b4acab2-c5d8-413e-8051-18917236dd40 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:07.749305 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b4acab2-c5d8-413e-8051-18917236dd40 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:07.749779 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b4acab2-c5d8-413e-8051-18917236dd40 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:07.750211 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b4acab2-c5d8-413e-8051-18917236dd40 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:07.750882 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b4acab2-c5d8-413e-8051-18917236dd40 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:07.751327 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b4acab2-c5d8-413e-8051-18917236dd40 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:07.751740 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b4acab2-c5d8-413e-8051-18917236dd40 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:07.884667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b4acab2-c5d8-413e-8051-18917236dd40 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:07.892211 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4b4acab2-c5d8-413e-8051-18917236dd40 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1313 microversion: 2.1 time: 0.153771 Aug 05 02:23:07.892841 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 239/479] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:07 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:08.508311 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7b37ce72-128b-440c-81ae-e3daefc85ae3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:08.508844 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7b37ce72-128b-440c-81ae-e3daefc85ae3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:08.511833 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:08.517090 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7b37ce72-128b-440c-81ae-e3daefc85ae3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:08.517564 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7b37ce72-128b-440c-81ae-e3daefc85ae3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:08.518013 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7b37ce72-128b-440c-81ae-e3daefc85ae3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:08.518844 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7b37ce72-128b-440c-81ae-e3daefc85ae3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:08.519294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7b37ce72-128b-440c-81ae-e3daefc85ae3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:08.519707 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7b37ce72-128b-440c-81ae-e3daefc85ae3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:08.646974 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7b37ce72-128b-440c-81ae-e3daefc85ae3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:08.654430 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7b37ce72-128b-440c-81ae-e3daefc85ae3 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.150067 Aug 05 02:23:08.654990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 241/480] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:08 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:08.913050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f694e063-47f6-46bc-bfad-c637f25b919d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:08.913655 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f694e063-47f6-46bc-bfad-c637f25b919d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:08.920983 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f694e063-47f6-46bc-bfad-c637f25b919d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:08.921462 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f694e063-47f6-46bc-bfad-c637f25b919d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:08.921926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f694e063-47f6-46bc-bfad-c637f25b919d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:08.922610 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f694e063-47f6-46bc-bfad-c637f25b919d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:08.923057 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f694e063-47f6-46bc-bfad-c637f25b919d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:08.923476 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f694e063-47f6-46bc-bfad-c637f25b919d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:09.054000 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f694e063-47f6-46bc-bfad-c637f25b919d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:09.062470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f694e063-47f6-46bc-bfad-c637f25b919d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1313 microversion: 2.1 time: 0.153219 Aug 05 02:23:09.063028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 240/481] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:08 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:09.609749 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-eb4f0df1-2636-40df-ae28-73c6fb2323cc req-10680aa4-2183-44ec-bdcc-7481c7f7d9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "865edaf2-33cf-496d-a052-35aa26d85c59", "name": "network-vif-plugged", "status": "completed", "tag": "25ab673e-d0f2-4f57-ab69-0df7d17ddc78"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:23:09.621790 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-eb4f0df1-2636-40df-ae28-73c6fb2323cc req-10680aa4-2183-44ec-bdcc-7481c7f7d9e6 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:09.622274 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-eb4f0df1-2636-40df-ae28-73c6fb2323cc req-10680aa4-2183-44ec-bdcc-7481c7f7d9e6 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:09.622702 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-eb4f0df1-2636-40df-ae28-73c6fb2323cc req-10680aa4-2183-44ec-bdcc-7481c7f7d9e6 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:09.636063 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-eb4f0df1-2636-40df-ae28-73c6fb2323cc req-10680aa4-2183-44ec-bdcc-7481c7f7d9e6 service nova] Creating event network-vif-plugged:25ab673e-d0f2-4f57-ab69-0df7d17ddc78 for instance 865edaf2-33cf-496d-a052-35aa26d85c59 on hv-cinder-81558 Aug 05 02:23:09.641886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-eb4f0df1-2636-40df-ae28-73c6fb2323cc req-10680aa4-2183-44ec-bdcc-7481c7f7d9e6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037532 Aug 05 02:23:09.642854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 242/482] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:23:09.687889 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-237b9f92-0db3-488f-ad1d-37a1f5d737e4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:09.688937 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-237b9f92-0db3-488f-ad1d-37a1f5d737e4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:09.704791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-237b9f92-0db3-488f-ad1d-37a1f5d737e4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:09.705289 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-237b9f92-0db3-488f-ad1d-37a1f5d737e4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:09.705726 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-237b9f92-0db3-488f-ad1d-37a1f5d737e4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:09.706428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-237b9f92-0db3-488f-ad1d-37a1f5d737e4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:09.706884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-237b9f92-0db3-488f-ad1d-37a1f5d737e4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:09.707438 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-237b9f92-0db3-488f-ad1d-37a1f5d737e4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:09.933585 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-237b9f92-0db3-488f-ad1d-37a1f5d737e4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:09.944991 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-237b9f92-0db3-488f-ad1d-37a1f5d737e4 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.273080 Aug 05 02:23:09.945965 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 241/483] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:09 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:10.083529 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8e09f177-5983-47b8-903d-b09baf0a28b3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:10.084232 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8e09f177-5983-47b8-903d-b09baf0a28b3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:10.091020 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8e09f177-5983-47b8-903d-b09baf0a28b3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:10.091509 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8e09f177-5983-47b8-903d-b09baf0a28b3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:10.091945 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8e09f177-5983-47b8-903d-b09baf0a28b3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:10.092680 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8e09f177-5983-47b8-903d-b09baf0a28b3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:10.093133 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8e09f177-5983-47b8-903d-b09baf0a28b3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:10.093556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8e09f177-5983-47b8-903d-b09baf0a28b3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:10.259526 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8e09f177-5983-47b8-903d-b09baf0a28b3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:10.267273 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8e09f177-5983-47b8-903d-b09baf0a28b3 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1313 microversion: 2.1 time: 0.187891 Aug 05 02:23:10.267881 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 243/484] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:10 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:10.969804 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-50ae592b-9e51-49fb-a859-c0a445e48386 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:10.970411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-50ae592b-9e51-49fb-a859-c0a445e48386 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:10.972411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:10.973096 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:10.979499 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50ae592b-9e51-49fb-a859-c0a445e48386 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:10.979986 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50ae592b-9e51-49fb-a859-c0a445e48386 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:10.980441 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50ae592b-9e51-49fb-a859-c0a445e48386 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:10.981134 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50ae592b-9e51-49fb-a859-c0a445e48386 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:10.981579 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50ae592b-9e51-49fb-a859-c0a445e48386 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:10.981997 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-50ae592b-9e51-49fb-a859-c0a445e48386 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:11.053431 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-90690c16-e15e-4600-ad5d-063c92f43316 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:11.053890 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-90690c16-e15e-4600-ad5d-063c92f43316 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:11.056714 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:11.063001 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-90690c16-e15e-4600-ad5d-063c92f43316 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:11.063557 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-90690c16-e15e-4600-ad5d-063c92f43316 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:11.064147 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-90690c16-e15e-4600-ad5d-063c92f43316 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:11.064878 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-90690c16-e15e-4600-ad5d-063c92f43316 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:11.065322 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-90690c16-e15e-4600-ad5d-063c92f43316 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:11.065736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-90690c16-e15e-4600-ad5d-063c92f43316 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:11.117873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-50ae592b-9e51-49fb-a859-c0a445e48386 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:11.126027 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-50ae592b-9e51-49fb-a859-c0a445e48386 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.161032 Aug 05 02:23:11.126579 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 242/485] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:10 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:11.197118 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-90690c16-e15e-4600-ad5d-063c92f43316 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:11.205414 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-90690c16-e15e-4600-ad5d-063c92f43316 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1593 microversion: 2.1 time: 0.156801 Aug 05 02:23:11.205975 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 244/486] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:11 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1593 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:23:11.288055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-316d376a-335e-41e2-914d-a4865b94795e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:11.288806 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-316d376a-335e-41e2-914d-a4865b94795e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:11.294815 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-316d376a-335e-41e2-914d-a4865b94795e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:11.295290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-316d376a-335e-41e2-914d-a4865b94795e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:11.295720 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-316d376a-335e-41e2-914d-a4865b94795e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:11.296463 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-316d376a-335e-41e2-914d-a4865b94795e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:11.296913 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-316d376a-335e-41e2-914d-a4865b94795e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:11.297334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-316d376a-335e-41e2-914d-a4865b94795e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:11.437722 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-316d376a-335e-41e2-914d-a4865b94795e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:11.445311 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-316d376a-335e-41e2-914d-a4865b94795e tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1313 microversion: 2.1 time: 0.161614 Aug 05 02:23:11.445871 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 243/487] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:11 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:12.147815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-50d82d2d-fb6f-4806-ac32-47ee397c1751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:12.148521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-50d82d2d-fb6f-4806-ac32-47ee397c1751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:12.160673 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50d82d2d-fb6f-4806-ac32-47ee397c1751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:12.161236 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50d82d2d-fb6f-4806-ac32-47ee397c1751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:12.161739 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50d82d2d-fb6f-4806-ac32-47ee397c1751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:12.162515 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50d82d2d-fb6f-4806-ac32-47ee397c1751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:12.162970 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50d82d2d-fb6f-4806-ac32-47ee397c1751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:12.163403 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50d82d2d-fb6f-4806-ac32-47ee397c1751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:12.308594 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-50d82d2d-fb6f-4806-ac32-47ee397c1751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:12.317663 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-50d82d2d-fb6f-4806-ac32-47ee397c1751 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.173641 Aug 05 02:23:12.318642 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 245/488] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:12 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:12.467143 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bc36c10d-26af-4c29-b47c-701a84287239 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:12.468487 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bc36c10d-26af-4c29-b47c-701a84287239 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:12.476386 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc36c10d-26af-4c29-b47c-701a84287239 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:12.476908 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc36c10d-26af-4c29-b47c-701a84287239 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:12.477430 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc36c10d-26af-4c29-b47c-701a84287239 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:12.479244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc36c10d-26af-4c29-b47c-701a84287239 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:12.480344 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc36c10d-26af-4c29-b47c-701a84287239 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:12.480984 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc36c10d-26af-4c29-b47c-701a84287239 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:12.690942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bc36c10d-26af-4c29-b47c-701a84287239 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:12.699009 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bc36c10d-26af-4c29-b47c-701a84287239 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1313 microversion: 2.1 time: 0.236543 Aug 05 02:23:12.699580 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 244/489] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:12 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:13.339977 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c4466d02-4b1f-4b8c-bb53-ef29d083fb17 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:13.340789 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c4466d02-4b1f-4b8c-bb53-ef29d083fb17 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:13.356456 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-c42d4fc1-5bbb-4c4f-985d-51938f81664f req-305b018c-2c47-442f-8e2f-bf240f065973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c8e9d9-004f-4693-a78d-77027c30aede", "tag": "9017b9e3-fdca-4fff-a053-ec122ab62248"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:23:13.366407 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c42d4fc1-5bbb-4c4f-985d-51938f81664f req-305b018c-2c47-442f-8e2f-bf240f065973 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:13.367076 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c4466d02-4b1f-4b8c-bb53-ef29d083fb17 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:13.367285 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c42d4fc1-5bbb-4c4f-985d-51938f81664f req-305b018c-2c47-442f-8e2f-bf240f065973 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:13.367905 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c42d4fc1-5bbb-4c4f-985d-51938f81664f req-305b018c-2c47-442f-8e2f-bf240f065973 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:13.369452 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c4466d02-4b1f-4b8c-bb53-ef29d083fb17 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:13.370409 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c4466d02-4b1f-4b8c-bb53-ef29d083fb17 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:13.375065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c4466d02-4b1f-4b8c-bb53-ef29d083fb17 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:13.381542 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-c42d4fc1-5bbb-4c4f-985d-51938f81664f req-305b018c-2c47-442f-8e2f-bf240f065973 service nova] Creating event network-changed:9017b9e3-fdca-4fff-a053-ec122ab62248 for instance d5c8e9d9-004f-4693-a78d-77027c30aede on hv-cinder-81558 Aug 05 02:23:13.382247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c4466d02-4b1f-4b8c-bb53-ef29d083fb17 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:13.382774 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c4466d02-4b1f-4b8c-bb53-ef29d083fb17 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:13.389303 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-c42d4fc1-5bbb-4c4f-985d-51938f81664f req-305b018c-2c47-442f-8e2f-bf240f065973 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037340 Aug 05 02:23:13.393982 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 245/490] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:23:13.588066 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c4466d02-4b1f-4b8c-bb53-ef29d083fb17 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:13.614644 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c4466d02-4b1f-4b8c-bb53-ef29d083fb17 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1503 microversion: 2.1 time: 0.280270 Aug 05 02:23:13.615239 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 246/491] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:13 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1503 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:13.642002 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ca49ab32-a452-4c82-928f-4344860f717d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e2b46eb-7990-482e-aa11-f61d4ea60db3"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:23:13.646157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ca49ab32-a452-4c82-928f-4344860f717d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:13.652302 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:13.654054 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca49ab32-a452-4c82-928f-4344860f717d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:13.654986 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca49ab32-a452-4c82-928f-4344860f717d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:13.655555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca49ab32-a452-4c82-928f-4344860f717d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:13.656439 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca49ab32-a452-4c82-928f-4344860f717d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:13.659139 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca49ab32-a452-4c82-928f-4344860f717d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:13.660174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca49ab32-a452-4c82-928f-4344860f717d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:13.692137 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-ca49ab32-a452-4c82-928f-4344860f717d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] HTTP exception thrown: Cannot 'attach_volume' instance 786487b8-f24e-4034-82da-c95e8efbf4e4 while it is in vm_state rescued Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ca49ab32-a452-4c82-928f-4344860f717d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Request method failure captured: Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4/os-volume_attachments HTTP/1.1 Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 74 Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5uCxqFMV4xjjNEicbwn-Almmx4gjc1pUb71A8FIyVx8kunNx-w_ca81bXVAOmrqecVOU6tQQ9CUuL6-vxI4zUOkgPqmvK3bhOYSnsCfmASkY-Ed2wRrlD38yMwuEjNowSpZxw4W5LwuL9n11WU2krtppQjp6wb1pPplKkDftUslgY Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 00eaaf2e12844123996e26c1827d80b2 Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2105783776 Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:23:13.694077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:23:13.695646 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/00eaaf2e12844123996e26c1827d80b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_00eaaf2e12844123996e26c1827d80b2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/00eaaf2e12844123996e26c1827d80b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/00eaaf2e12844123996e26c1827d80b2"}]}] Aug 05 02:23:13.695646 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2105783776 Aug 05 02:23:13.695646 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 00eaaf2e12844123996e26c1827d80b2 Aug 05 02:23:13.695646 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2105783776 Aug 05 02:23:13.695646 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-2105783776-project Aug 05 02:23:13.695646 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:23:13.695646 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:23:13.695646 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 5bf84408a3984972a5bb68a3117c0501 Aug 05 02:23:13.695646 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2105783776-project Aug 05 02:23:13.695646 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Aug 05 02:23:13.695646 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {"volumeAttachment": {"volumeId": "9e2b46eb-7990-482e-aa11-f61d4ea60db3"}} Aug 05 02:23:13.695646 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Cannot 'attach_volume' instance 786487b8-f24e-4034-82da-c95e8efbf4e4 while it is in vm_state rescued Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'server_id': '786487b8-f24e-4034-82da-c95e8efbf4e4', 'body': {'volumeAttachment': {'volumeId': '9e2b46eb-7990-482e-aa11-f61d4ea60db3'}}} Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 786487b8-f24e-4034-82da-c95e8efbf4e4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:23:13.696829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 786487b8-f24e-4034-82da-c95e8efbf4e4 while it is in vm_state rescued Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:23:13.699435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:23:13.700905 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:23:13.700905 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:23:13.700905 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 786487b8-f24e-4034-82da-c95e8efbf4e4 while it is in vm_state rescued Aug 05 02:23:13.700905 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:23:13.700905 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ca49ab32-a452-4c82-928f-4344860f717d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Returning 409 to user: Cannot 'attach_volume' instance 786487b8-f24e-4034-82da-c95e8efbf4e4 while it is in vm_state rescued {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:23:13.700905 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ca49ab32-a452-4c82-928f-4344860f717d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "POST /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.059524 Aug 05 02:23:13.703021 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 246/492] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Aug 5 02:23:13 2022] POST /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4/os-volume_attachments => generated 152 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 05 02:23:13.705038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9500191e-1719-4d7c-ab7f-b9918ed3c7ae tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:23:13.705563 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9500191e-1719-4d7c-ab7f-b9918ed3c7ae tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:13.717307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9500191e-1719-4d7c-ab7f-b9918ed3c7ae tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:13.717794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9500191e-1719-4d7c-ab7f-b9918ed3c7ae tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:13.718219 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9500191e-1719-4d7c-ab7f-b9918ed3c7ae tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:13.719159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9500191e-1719-4d7c-ab7f-b9918ed3c7ae tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:13.721034 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1deed708-b824-4d94-9e22-97c1906d1fdb tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:13.721243 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9500191e-1719-4d7c-ab7f-b9918ed3c7ae tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:13.721664 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1deed708-b824-4d94-9e22-97c1906d1fdb tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:13.721778 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9500191e-1719-4d7c-ab7f-b9918ed3c7ae tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:13.728831 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1deed708-b824-4d94-9e22-97c1906d1fdb tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:13.729500 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1deed708-b824-4d94-9e22-97c1906d1fdb tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:13.730031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1deed708-b824-4d94-9e22-97c1906d1fdb tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:13.730731 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1deed708-b824-4d94-9e22-97c1906d1fdb tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:13.731372 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1deed708-b824-4d94-9e22-97c1906d1fdb tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:13.732566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1deed708-b824-4d94-9e22-97c1906d1fdb tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:13.810041 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9500191e-1719-4d7c-ab7f-b9918ed3c7ae tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "POST /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4/action" status: 202 len: 0 microversion: 2.1 time: 0.108479 Aug 05 02:23:13.811337 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 247/493] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Aug 5 02:23:13 2022] POST /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 02:23:13.824422 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8f67dec6-8b64-48d4-90ee-321528672357 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:13.825444 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8f67dec6-8b64-48d4-90ee-321528672357 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:13.845470 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f67dec6-8b64-48d4-90ee-321528672357 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:13.846183 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f67dec6-8b64-48d4-90ee-321528672357 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:13.846696 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f67dec6-8b64-48d4-90ee-321528672357 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:13.847819 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f67dec6-8b64-48d4-90ee-321528672357 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:13.848471 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f67dec6-8b64-48d4-90ee-321528672357 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:13.848963 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8f67dec6-8b64-48d4-90ee-321528672357 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:13.919878 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1deed708-b824-4d94-9e22-97c1906d1fdb tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:13.929275 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1deed708-b824-4d94-9e22-97c1906d1fdb tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1496 microversion: 2.1 time: 0.213885 Aug 05 02:23:13.945779 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 247/494] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:13 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1496 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:14.528955 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8f67dec6-8b64-48d4-90ee-321528672357 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:14.542911 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8f67dec6-8b64-48d4-90ee-321528672357 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1511 microversion: 2.1 time: 0.725596 Aug 05 02:23:14.544273 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 248/495] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:13 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1511 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:14.756861 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-290f173f-376c-437a-91bf-f53ed042bbd7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:14.757518 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-290f173f-376c-437a-91bf-f53ed042bbd7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:14.763912 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-290f173f-376c-437a-91bf-f53ed042bbd7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:14.764653 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-290f173f-376c-437a-91bf-f53ed042bbd7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:14.765258 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-290f173f-376c-437a-91bf-f53ed042bbd7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:14.766129 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-290f173f-376c-437a-91bf-f53ed042bbd7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:14.766734 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-290f173f-376c-437a-91bf-f53ed042bbd7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:14.767307 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-290f173f-376c-437a-91bf-f53ed042bbd7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:14.800360 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-290f173f-376c-437a-91bf-f53ed042bbd7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:23:14.940896 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-290f173f-376c-437a-91bf-f53ed042bbd7 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "DELETE /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 204 len: 0 microversion: 2.1 time: 0.187467 Aug 05 02:23:14.942358 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 248/496] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:23:14 2022] DELETE /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:23:14.951858 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e17d42f6-8824-4f88-b978-1824295621ce tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:14.952907 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e17d42f6-8824-4f88-b978-1824295621ce tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:14.959029 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e17d42f6-8824-4f88-b978-1824295621ce tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:14.959440 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e17d42f6-8824-4f88-b978-1824295621ce tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:14.959868 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e17d42f6-8824-4f88-b978-1824295621ce tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:14.960595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e17d42f6-8824-4f88-b978-1824295621ce tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:14.961037 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e17d42f6-8824-4f88-b978-1824295621ce tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:14.961625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e17d42f6-8824-4f88-b978-1824295621ce tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:15.122539 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e17d42f6-8824-4f88-b978-1824295621ce tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:15.132137 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e17d42f6-8824-4f88-b978-1824295621ce tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1502 microversion: 2.1 time: 0.184460 Aug 05 02:23:15.132926 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 249/497] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:14 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:15.163525 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-790d64e9-286d-4ac5-9e14-0bac506cc936 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-502304730"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:23:15.163525 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-790d64e9-286d-4ac5-9e14-0bac506cc936 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:15.168034 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-790d64e9-286d-4ac5-9e14-0bac506cc936 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:15.168559 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-790d64e9-286d-4ac5-9e14-0bac506cc936 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:15.168996 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-790d64e9-286d-4ac5-9e14-0bac506cc936 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:15.169689 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-790d64e9-286d-4ac5-9e14-0bac506cc936 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:15.170257 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-790d64e9-286d-4ac5-9e14-0bac506cc936 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:15.170547 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-790d64e9-286d-4ac5-9e14-0bac506cc936 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:15.310588 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.network.security_group_api [None req-790d64e9-286d-4ac5-9e14-0bac506cc936 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Adding security group 246e9fa9-513c-4d87-ba3e-6f6410a59cf3 to port 9017b9e3-fdca-4fff-a053-ec122ab62248 Aug 05 02:23:15.564529 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-962ff3d9-b6fb-480c-80e0-4cc9e79407fa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:15.565139 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-962ff3d9-b6fb-480c-80e0-4cc9e79407fa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:15.571259 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-962ff3d9-b6fb-480c-80e0-4cc9e79407fa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:15.571738 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-962ff3d9-b6fb-480c-80e0-4cc9e79407fa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:15.572161 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-962ff3d9-b6fb-480c-80e0-4cc9e79407fa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:15.573785 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-962ff3d9-b6fb-480c-80e0-4cc9e79407fa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:15.574425 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-962ff3d9-b6fb-480c-80e0-4cc9e79407fa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:15.574848 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-962ff3d9-b6fb-480c-80e0-4cc9e79407fa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:15.680122 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-790d64e9-286d-4ac5-9e14-0bac506cc936 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "POST /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/action" status: 202 len: 0 microversion: 2.1 time: 0.522880 Aug 05 02:23:15.681072 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 249/498] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Aug 5 02:23:15 2022] POST /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:23:15.689103 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5e6dd802-fd1e-402b-896a-1b7d87803207 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:15.690364 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5e6dd802-fd1e-402b-896a-1b7d87803207 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:15.696720 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e6dd802-fd1e-402b-896a-1b7d87803207 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:15.697807 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e6dd802-fd1e-402b-896a-1b7d87803207 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:15.699047 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e6dd802-fd1e-402b-896a-1b7d87803207 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:15.699877 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e6dd802-fd1e-402b-896a-1b7d87803207 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:15.700539 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e6dd802-fd1e-402b-896a-1b7d87803207 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:15.700966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e6dd802-fd1e-402b-896a-1b7d87803207 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:15.747559 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-962ff3d9-b6fb-480c-80e0-4cc9e79407fa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:15.755155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-962ff3d9-b6fb-480c-80e0-4cc9e79407fa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1511 microversion: 2.1 time: 0.194951 Aug 05 02:23:15.771197 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 250/499] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:15 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1511 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:23:15.777515 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-eafaefa2-8b3f-44cb-a0bf-288cde748651 req-7438ffe7-52a4-4741-ad10-729d78a3445f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c8e9d9-004f-4693-a78d-77027c30aede", "tag": "9017b9e3-fdca-4fff-a053-ec122ab62248"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:23:15.788680 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-eafaefa2-8b3f-44cb-a0bf-288cde748651 req-7438ffe7-52a4-4741-ad10-729d78a3445f service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:15.789433 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-eafaefa2-8b3f-44cb-a0bf-288cde748651 req-7438ffe7-52a4-4741-ad10-729d78a3445f service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:15.790023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-eafaefa2-8b3f-44cb-a0bf-288cde748651 req-7438ffe7-52a4-4741-ad10-729d78a3445f service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:15.804800 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-eafaefa2-8b3f-44cb-a0bf-288cde748651 req-7438ffe7-52a4-4741-ad10-729d78a3445f service nova] Creating event network-changed:9017b9e3-fdca-4fff-a053-ec122ab62248 for instance d5c8e9d9-004f-4693-a78d-77027c30aede on hv-cinder-81558 Aug 05 02:23:15.811830 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-eafaefa2-8b3f-44cb-a0bf-288cde748651 req-7438ffe7-52a4-4741-ad10-729d78a3445f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039062 Aug 05 02:23:15.812695 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 251/500] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:23:15.928586 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5e6dd802-fd1e-402b-896a-1b7d87803207 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:15.938046 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5e6dd802-fd1e-402b-896a-1b7d87803207 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1639 microversion: 2.1 time: 0.252635 Aug 05 02:23:15.938941 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 250/501] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:15 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1639 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:23:16.155714 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-596d0587-5fc1-417e-8ead-db9acab5f57d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:16.156840 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-596d0587-5fc1-417e-8ead-db9acab5f57d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:16.165029 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-596d0587-5fc1-417e-8ead-db9acab5f57d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:16.166030 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-596d0587-5fc1-417e-8ead-db9acab5f57d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:16.166727 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-596d0587-5fc1-417e-8ead-db9acab5f57d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:16.167693 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-596d0587-5fc1-417e-8ead-db9acab5f57d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:16.168474 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-596d0587-5fc1-417e-8ead-db9acab5f57d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:16.169048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-596d0587-5fc1-417e-8ead-db9acab5f57d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:16.461300 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-596d0587-5fc1-417e-8ead-db9acab5f57d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:16.471959 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-596d0587-5fc1-417e-8ead-db9acab5f57d tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1502 microversion: 2.1 time: 0.322076 Aug 05 02:23:16.473636 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 252/502] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:16 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1502 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:16.780313 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2c90faef-7c66-4293-8b20-c2b059bea71a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:16.780974 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2c90faef-7c66-4293-8b20-c2b059bea71a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:16.790598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2c90faef-7c66-4293-8b20-c2b059bea71a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:16.791196 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2c90faef-7c66-4293-8b20-c2b059bea71a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:16.791674 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2c90faef-7c66-4293-8b20-c2b059bea71a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:16.792346 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2c90faef-7c66-4293-8b20-c2b059bea71a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:16.792814 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2c90faef-7c66-4293-8b20-c2b059bea71a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:16.793245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2c90faef-7c66-4293-8b20-c2b059bea71a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:16.937455 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2c90faef-7c66-4293-8b20-c2b059bea71a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:16.945938 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2c90faef-7c66-4293-8b20-c2b059bea71a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1511 microversion: 2.1 time: 0.169452 Aug 05 02:23:16.946498 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 251/503] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:16 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:17.493585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2ecdb271-261b-43ed-812b-09ca1215ff45 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:17.496268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2ecdb271-261b-43ed-812b-09ca1215ff45 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:17.510441 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ecdb271-261b-43ed-812b-09ca1215ff45 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:17.511645 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ecdb271-261b-43ed-812b-09ca1215ff45 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:17.512802 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ecdb271-261b-43ed-812b-09ca1215ff45 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:17.513872 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ecdb271-261b-43ed-812b-09ca1215ff45 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:17.526131 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ecdb271-261b-43ed-812b-09ca1215ff45 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:17.526770 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2ecdb271-261b-43ed-812b-09ca1215ff45 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:17.589110 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-f1f8608f-09a7-4a86-bf66-679759ab4c71 req-9557af40-ad4c-46c7-9b5e-12d7741c151b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "865edaf2-33cf-496d-a052-35aa26d85c59", "name": "network-vif-deleted", "tag": "25ab673e-d0f2-4f57-ab69-0df7d17ddc78"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:23:17.600963 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f1f8608f-09a7-4a86-bf66-679759ab4c71 req-9557af40-ad4c-46c7-9b5e-12d7741c151b service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:17.601733 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f1f8608f-09a7-4a86-bf66-679759ab4c71 req-9557af40-ad4c-46c7-9b5e-12d7741c151b service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:17.602393 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f1f8608f-09a7-4a86-bf66-679759ab4c71 req-9557af40-ad4c-46c7-9b5e-12d7741c151b service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:17.607229 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2ecdb271-261b-43ed-812b-09ca1215ff45 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:17.621335 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2ecdb271-261b-43ed-812b-09ca1215ff45 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1460 microversion: 2.1 time: 0.132037 Aug 05 02:23:17.626793 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-f1f8608f-09a7-4a86-bf66-679759ab4c71 req-9557af40-ad4c-46c7-9b5e-12d7741c151b service nova] Creating event network-vif-deleted:25ab673e-d0f2-4f57-ab69-0df7d17ddc78 for instance 865edaf2-33cf-496d-a052-35aa26d85c59 on hv-cinder-81558 Aug 05 02:23:17.631671 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-f1f8608f-09a7-4a86-bf66-679759ab4c71 req-9557af40-ad4c-46c7-9b5e-12d7741c151b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046955 Aug 05 02:23:17.632257 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 252/504] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:23:17.634778 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 253/505] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:17 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1460 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:17.968585 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0964b4e6-00a7-463f-ae56-bc077e2a8643 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:17.969666 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0964b4e6-00a7-463f-ae56-bc077e2a8643 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:17.975697 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0964b4e6-00a7-463f-ae56-bc077e2a8643 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:17.976171 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0964b4e6-00a7-463f-ae56-bc077e2a8643 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:17.976657 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0964b4e6-00a7-463f-ae56-bc077e2a8643 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:17.977342 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0964b4e6-00a7-463f-ae56-bc077e2a8643 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:17.977787 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0964b4e6-00a7-463f-ae56-bc077e2a8643 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:17.978204 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0964b4e6-00a7-463f-ae56-bc077e2a8643 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:18.131373 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0964b4e6-00a7-463f-ae56-bc077e2a8643 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:18.140079 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0964b4e6-00a7-463f-ae56-bc077e2a8643 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1511 microversion: 2.1 time: 0.176156 Aug 05 02:23:18.140860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 253/506] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:17 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:18.642023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d45fe29a-246f-4c42-9bd6-d2cdeffef8dc tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:18.642611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d45fe29a-246f-4c42-9bd6-d2cdeffef8dc tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:18.648915 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d45fe29a-246f-4c42-9bd6-d2cdeffef8dc tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:18.649419 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d45fe29a-246f-4c42-9bd6-d2cdeffef8dc tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:18.649843 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d45fe29a-246f-4c42-9bd6-d2cdeffef8dc tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:18.650757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d45fe29a-246f-4c42-9bd6-d2cdeffef8dc tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:18.650956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d45fe29a-246f-4c42-9bd6-d2cdeffef8dc tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:18.651368 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d45fe29a-246f-4c42-9bd6-d2cdeffef8dc tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:18.716108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d45fe29a-246f-4c42-9bd6-d2cdeffef8dc tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:18.723607 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d45fe29a-246f-4c42-9bd6-d2cdeffef8dc tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1460 microversion: 2.1 time: 0.085521 Aug 05 02:23:18.724198 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 254/507] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:18 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1460 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:19.161582 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-805e4436-a53a-439a-b223-282077067559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:19.162184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-805e4436-a53a-439a-b223-282077067559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:19.169267 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-805e4436-a53a-439a-b223-282077067559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:19.169739 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-805e4436-a53a-439a-b223-282077067559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:19.170170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-805e4436-a53a-439a-b223-282077067559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:19.170847 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-805e4436-a53a-439a-b223-282077067559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:19.171292 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-805e4436-a53a-439a-b223-282077067559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:19.171711 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-805e4436-a53a-439a-b223-282077067559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:19.295868 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-805e4436-a53a-439a-b223-282077067559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:19.303158 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-805e4436-a53a-439a-b223-282077067559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1511 microversion: 2.1 time: 0.145438 Aug 05 02:23:19.303715 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 254/508] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:19 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1511 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:19.745848 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1c10d9fa-719c-4e2c-9b87-94028a6ce448 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:19.747170 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1c10d9fa-719c-4e2c-9b87-94028a6ce448 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:19.758786 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1c10d9fa-719c-4e2c-9b87-94028a6ce448 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:19.760287 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1c10d9fa-719c-4e2c-9b87-94028a6ce448 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:19.761079 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1c10d9fa-719c-4e2c-9b87-94028a6ce448 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:19.762101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1c10d9fa-719c-4e2c-9b87-94028a6ce448 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:19.762922 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1c10d9fa-719c-4e2c-9b87-94028a6ce448 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:19.763557 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1c10d9fa-719c-4e2c-9b87-94028a6ce448 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:19.783400 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:19.846681 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1c10d9fa-719c-4e2c-9b87-94028a6ce448 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:19.854740 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1c10d9fa-719c-4e2c-9b87-94028a6ce448 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1298 microversion: 2.1 time: 0.114111 Aug 05 02:23:19.855512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 255/509] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:19 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:23:20.324675 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5b609c1b-ce16-4a74-8773-194e43a0f32a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:20.325676 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5b609c1b-ce16-4a74-8773-194e43a0f32a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:20.332943 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b609c1b-ce16-4a74-8773-194e43a0f32a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:20.333427 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b609c1b-ce16-4a74-8773-194e43a0f32a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:20.333868 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b609c1b-ce16-4a74-8773-194e43a0f32a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:20.334557 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b609c1b-ce16-4a74-8773-194e43a0f32a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:20.335004 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b609c1b-ce16-4a74-8773-194e43a0f32a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:20.335422 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b609c1b-ce16-4a74-8773-194e43a0f32a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:20.340174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:20.490111 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5b609c1b-ce16-4a74-8773-194e43a0f32a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:20.497466 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5b609c1b-ce16-4a74-8773-194e43a0f32a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1511 microversion: 2.1 time: 0.177283 Aug 05 02:23:20.498030 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 255/510] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:20 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:20.880407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-14167cfd-1ebf-4368-b5a5-223312e632b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:20.881725 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-14167cfd-1ebf-4368-b5a5-223312e632b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:20.888795 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-14167cfd-1ebf-4368-b5a5-223312e632b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:20.889215 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-14167cfd-1ebf-4368-b5a5-223312e632b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:20.889652 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-14167cfd-1ebf-4368-b5a5-223312e632b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:20.890352 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-14167cfd-1ebf-4368-b5a5-223312e632b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:20.890809 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-14167cfd-1ebf-4368-b5a5-223312e632b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:20.891229 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-14167cfd-1ebf-4368-b5a5-223312e632b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:20.924399 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-14167cfd-1ebf-4368-b5a5-223312e632b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:20.924886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-14167cfd-1ebf-4368-b5a5-223312e632b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:20.925324 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-14167cfd-1ebf-4368-b5a5-223312e632b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:20.925762 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-14167cfd-1ebf-4368-b5a5-223312e632b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lazy-loading 'fault' on Instance uuid 865edaf2-33cf-496d-a052-35aa26d85c59 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:23:20.987970 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-14167cfd-1ebf-4368-b5a5-223312e632b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47d90567551e4cfb9bcc974e11d4e42c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14962cc915f647cc916994ec724de454', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:20.996753 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-14167cfd-1ebf-4368-b5a5-223312e632b9 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 200 len: 1303 microversion: 2.1 time: 0.125454 Aug 05 02:23:20.997963 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 256/511] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:20 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 1303 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:21.518687 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1dde1d5f-3afe-413e-9084-36e34e6acb28 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:21.519317 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1dde1d5f-3afe-413e-9084-36e34e6acb28 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:21.525756 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dde1d5f-3afe-413e-9084-36e34e6acb28 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:21.526760 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dde1d5f-3afe-413e-9084-36e34e6acb28 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:21.527197 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dde1d5f-3afe-413e-9084-36e34e6acb28 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:21.527881 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dde1d5f-3afe-413e-9084-36e34e6acb28 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:21.528383 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dde1d5f-3afe-413e-9084-36e34e6acb28 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:21.528833 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dde1d5f-3afe-413e-9084-36e34e6acb28 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:21.658824 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1dde1d5f-3afe-413e-9084-36e34e6acb28 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:21.666201 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1dde1d5f-3afe-413e-9084-36e34e6acb28 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1517 microversion: 2.1 time: 0.151365 Aug 05 02:23:21.666774 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 256/512] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:21 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:22.018998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cbbfabdb-c53c-4b72-938b-2c12065105b8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:22.019602 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cbbfabdb-c53c-4b72-938b-2c12065105b8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] [instance: 865edaf2-33cf-496d-a052-35aa26d85c59] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:22.026485 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbbfabdb-c53c-4b72-938b-2c12065105b8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:22.026932 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbbfabdb-c53c-4b72-938b-2c12065105b8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:22.027360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbbfabdb-c53c-4b72-938b-2c12065105b8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:22.028060 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbbfabdb-c53c-4b72-938b-2c12065105b8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:22.028509 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbbfabdb-c53c-4b72-938b-2c12065105b8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:22.028961 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbbfabdb-c53c-4b72-938b-2c12065105b8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:22.042680 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-cbbfabdb-c53c-4b72-938b-2c12065105b8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] HTTP exception thrown: Instance 865edaf2-33cf-496d-a052-35aa26d85c59 could not be found. Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cbbfabdb-c53c-4b72-938b-2c12065105b8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Request method failure captured: Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 HTTP/1.1 Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H7NdkH25qsPQRNupbVCKJg8iozQcU1cCjlNUgEKQjlAiawLln5kE4tnCQO1SvqAc9D9JR8empFoJlXZj9ZTeyG9OKtlnrhnjQPHh8Ebv0cmMFSQgVcy7Sbz2qvCkiQibj4Ix5orDKJ4T9_lHaD9g6qzSxegL2dMDsxM9sfbKBeBsE8 Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: 14962cc915f647cc916994ec724de454 Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesActionsTest-1350616301 Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:23:22.044294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:23:22.045913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/14962cc915f647cc916994ec724de454"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_14962cc915f647cc916994ec724de454", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/14962cc915f647cc916994ec724de454"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/14962cc915f647cc916994ec724de454"}]}] Aug 05 02:23:22.045913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesActionsTest-1350616301 Aug 05 02:23:22.045913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 14962cc915f647cc916994ec724de454 Aug 05 02:23:22.045913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesActionsTest-1350616301 Aug 05 02:23:22.045913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesActionsTest-1350616301-project Aug 05 02:23:22.045913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:23:22.045913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:23:22.045913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 47d90567551e4cfb9bcc974e11d4e42c Aug 05 02:23:22.045913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesActionsTest-1350616301-project Aug 05 02:23:22.045913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:23:22.045913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance 865edaf2-33cf-496d-a052-35aa26d85c59 could not be found. Aug 05 02:23:22.045913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': '865edaf2-33cf-496d-a052-35aa26d85c59'} Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 865edaf2-33cf-496d-a052-35aa26d85c59 could not be found. Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:23:22.046824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 865edaf2-33cf-496d-a052-35aa26d85c59 could not be found. Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 865edaf2-33cf-496d-a052-35aa26d85c59 could not be found. Aug 05 02:23:22.048305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:23:22.049560 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cbbfabdb-c53c-4b72-938b-2c12065105b8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] Returning 404 to user: Instance 865edaf2-33cf-496d-a052-35aa26d85c59 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:23:22.049560 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cbbfabdb-c53c-4b72-938b-2c12065105b8 tempest-VolumesActionsTest-1350616301 tempest-VolumesActionsTest-1350616301-project] 10.222.0.15 "GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59" status: 404 len: 111 microversion: 2.1 time: 0.030597 Aug 05 02:23:22.049560 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 257/513] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:22 2022] GET /compute/v2.1/servers/865edaf2-33cf-496d-a052-35aa26d85c59 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:23:27.216315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bac11e5b-4d29-4b34-b1bc-6734ad4b2f86 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Action: 'create', calling method: .version_select at 0x7fa65c76f790>, body: {"keypair": {"name": "tempest-keypair-794149257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPm03EUlqLpL9zIrCxYQezBbmCKqzBJ5TM+ZDu9u24vBUmFQBZD/Ww5FL7ShaeUm/JIJ9nRXjSeVxOJJxs80WrIkXEpmoZnNS980TyJiz7SoIzQjIYYWif8hyphJLq0tgQ=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:23:27.231796 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-bac11e5b-4d29-4b34-b1bc-6734ad4b2f86 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Getting quotas for project 00eaaf2e12844123996e26c1827d80b2. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:23:27.235569 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-bac11e5b-4d29-4b34-b1bc-6734ad4b2f86 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Getting quotas for user 5bf84408a3984972a5bb68a3117c0501 and project 00eaaf2e12844123996e26c1827d80b2. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:23:27.257943 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bac11e5b-4d29-4b34-b1bc-6734ad4b2f86 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046294 Aug 05 02:23:27.258539 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 257/514] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Aug 5 02:23:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:23:28.527713 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1873310236", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9bc7c284-9f26-422a-ac52-0cd8c7ee2353"}], "security_groups": [{"name": "tempest-securitygroup--141913535"}], "key_name": "tempest-keypair-794149257", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:23:28.630948 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] validate_networks() for [('9bc7c284-9f26-422a-ac52-0cd8c7ee2353', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:23:29.014265 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:23:29.014681 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:23:29.015177 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:23:29.015581 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:23:29.015993 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:23:29.024528 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:29.025000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:29.025427 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:29.026264 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:29.026708 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:29.027130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:29.043019 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Getting quotas for project 00eaaf2e12844123996e26c1827d80b2. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:23:29.046897 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Getting quotas for user 5bf84408a3984972a5bb68a3117c0501 and project 00eaaf2e12844123996e26c1827d80b2. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:23:29.057958 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:23:29.060152 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:23:29.107181 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b96caff3-9cda-4ad3-8fb1-292656ae5025 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.584274 Aug 05 02:23:29.107987 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 258/515] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:23:28 2022] POST /compute/v2.1/servers => generated 408 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:23:29.119092 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7eeceee8-4ae2-46f5-aeea-f4f80d7eead6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:29.120386 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7eeceee8-4ae2-46f5-aeea-f4f80d7eead6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:29.175428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7eeceee8-4ae2-46f5-aeea-f4f80d7eead6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:29.183288 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7eeceee8-4ae2-46f5-aeea-f4f80d7eead6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1245 microversion: 2.1 time: 0.068562 Aug 05 02:23:29.183856 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 258/516] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:29 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1245 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:30.204062 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3941f765-9b50-4d32-ae0a-f059c88151d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:30.204702 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3941f765-9b50-4d32-ae0a-f059c88151d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:30.211811 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3941f765-9b50-4d32-ae0a-f059c88151d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:30.212297 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3941f765-9b50-4d32-ae0a-f059c88151d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:30.212770 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3941f765-9b50-4d32-ae0a-f059c88151d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:30.213950 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3941f765-9b50-4d32-ae0a-f059c88151d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:30.214404 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3941f765-9b50-4d32-ae0a-f059c88151d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:30.214830 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3941f765-9b50-4d32-ae0a-f059c88151d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:30.277819 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3941f765-9b50-4d32-ae0a-f059c88151d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:30.285181 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3941f765-9b50-4d32-ae0a-f059c88151d8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1249 microversion: 2.1 time: 0.085229 Aug 05 02:23:30.285740 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 259/517] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:30 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:31.306088 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-621c1435-7a0b-4c60-a152-e6b07974d93e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:31.307250 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-621c1435-7a0b-4c60-a152-e6b07974d93e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:31.314309 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-621c1435-7a0b-4c60-a152-e6b07974d93e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:31.314800 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-621c1435-7a0b-4c60-a152-e6b07974d93e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:31.315262 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-621c1435-7a0b-4c60-a152-e6b07974d93e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:31.315951 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-621c1435-7a0b-4c60-a152-e6b07974d93e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:31.316436 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-621c1435-7a0b-4c60-a152-e6b07974d93e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:31.316864 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-621c1435-7a0b-4c60-a152-e6b07974d93e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:31.376653 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-621c1435-7a0b-4c60-a152-e6b07974d93e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:31.384144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-621c1435-7a0b-4c60-a152-e6b07974d93e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1241 microversion: 2.1 time: 0.081821 Aug 05 02:23:31.384742 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 259/518] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:31 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:32.405421 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3de6abaf-9657-4db8-ae29-a984bd545d50 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:32.406155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3de6abaf-9657-4db8-ae29-a984bd545d50 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:32.412542 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3de6abaf-9657-4db8-ae29-a984bd545d50 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:32.413101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3de6abaf-9657-4db8-ae29-a984bd545d50 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:32.413605 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3de6abaf-9657-4db8-ae29-a984bd545d50 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:32.414300 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3de6abaf-9657-4db8-ae29-a984bd545d50 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:32.414752 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3de6abaf-9657-4db8-ae29-a984bd545d50 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:32.415171 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3de6abaf-9657-4db8-ae29-a984bd545d50 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:32.478006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3de6abaf-9657-4db8-ae29-a984bd545d50 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:32.485527 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3de6abaf-9657-4db8-ae29-a984bd545d50 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1305 microversion: 2.1 time: 0.084561 Aug 05 02:23:32.491028 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 260/519] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:32 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1305 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:33.509853 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9ca6dbc6-27e9-40b0-ac6a-d19da4cf3c01 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:33.510765 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9ca6dbc6-27e9-40b0-ac6a-d19da4cf3c01 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:33.519949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ca6dbc6-27e9-40b0-ac6a-d19da4cf3c01 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:33.520470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ca6dbc6-27e9-40b0-ac6a-d19da4cf3c01 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:33.521076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ca6dbc6-27e9-40b0-ac6a-d19da4cf3c01 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:33.522100 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ca6dbc6-27e9-40b0-ac6a-d19da4cf3c01 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:33.522721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ca6dbc6-27e9-40b0-ac6a-d19da4cf3c01 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:33.523295 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ca6dbc6-27e9-40b0-ac6a-d19da4cf3c01 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:33.710479 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9ca6dbc6-27e9-40b0-ac6a-d19da4cf3c01 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:33.721967 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9ca6dbc6-27e9-40b0-ac6a-d19da4cf3c01 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1370 microversion: 2.1 time: 0.218749 Aug 05 02:23:33.722556 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 260/520] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:33 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:34.125783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-1e2c2c69-22f2-4555-88ed-d3ebf146695e req-4ae599ff-4418-4865-a8cb-218f71ef8c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c37a85-a2b7-4dec-983c-5b65e70c3aa0", "tag": "025ccb86-82f0-4646-825e-bf471dd56047"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:23:34.148439 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-1e2c2c69-22f2-4555-88ed-d3ebf146695e req-4ae599ff-4418-4865-a8cb-218f71ef8c54 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:34.151029 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-1e2c2c69-22f2-4555-88ed-d3ebf146695e req-4ae599ff-4418-4865-a8cb-218f71ef8c54 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:34.153017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-1e2c2c69-22f2-4555-88ed-d3ebf146695e req-4ae599ff-4418-4865-a8cb-218f71ef8c54 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:34.177462 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-1e2c2c69-22f2-4555-88ed-d3ebf146695e req-4ae599ff-4418-4865-a8cb-218f71ef8c54 service nova] Creating event network-changed:025ccb86-82f0-4646-825e-bf471dd56047 for instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 on hv-cinder-81558 Aug 05 02:23:34.183420 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-1e2c2c69-22f2-4555-88ed-d3ebf146695e req-4ae599ff-4418-4865-a8cb-218f71ef8c54 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067261 Aug 05 02:23:34.184167 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 261/521] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:23:34.761723 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-958df51f-9c55-4d1f-b208-9304215ea91b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:34.763217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-958df51f-9c55-4d1f-b208-9304215ea91b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:34.771728 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-958df51f-9c55-4d1f-b208-9304215ea91b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:34.772720 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-958df51f-9c55-4d1f-b208-9304215ea91b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:34.773409 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-958df51f-9c55-4d1f-b208-9304215ea91b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:34.779232 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-958df51f-9c55-4d1f-b208-9304215ea91b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:34.779996 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-958df51f-9c55-4d1f-b208-9304215ea91b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:34.780926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-958df51f-9c55-4d1f-b208-9304215ea91b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:35.017218 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-958df51f-9c55-4d1f-b208-9304215ea91b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:35.033958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-958df51f-9c55-4d1f-b208-9304215ea91b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1370 microversion: 2.1 time: 0.278378 Aug 05 02:23:35.034798 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 261/522] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:34 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1370 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:36.055089 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-40c4d3bb-a072-490b-8990-b5768b018ae9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:36.055782 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-40c4d3bb-a072-490b-8990-b5768b018ae9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:36.067554 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40c4d3bb-a072-490b-8990-b5768b018ae9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:36.068053 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40c4d3bb-a072-490b-8990-b5768b018ae9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:36.068520 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40c4d3bb-a072-490b-8990-b5768b018ae9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:36.069220 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40c4d3bb-a072-490b-8990-b5768b018ae9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:36.069799 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40c4d3bb-a072-490b-8990-b5768b018ae9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:36.070220 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40c4d3bb-a072-490b-8990-b5768b018ae9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:36.217958 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-40c4d3bb-a072-490b-8990-b5768b018ae9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:36.226553 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-40c4d3bb-a072-490b-8990-b5768b018ae9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1370 microversion: 2.1 time: 0.175469 Aug 05 02:23:36.227865 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 262/523] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:36 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:37.249117 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f88c7487-d6ae-4803-9801-da9401c6ae1c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:37.250411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f88c7487-d6ae-4803-9801-da9401c6ae1c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:37.260130 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f88c7487-d6ae-4803-9801-da9401c6ae1c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:37.261270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f88c7487-d6ae-4803-9801-da9401c6ae1c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:37.262088 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f88c7487-d6ae-4803-9801-da9401c6ae1c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:37.263041 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f88c7487-d6ae-4803-9801-da9401c6ae1c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:37.263781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f88c7487-d6ae-4803-9801-da9401c6ae1c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:37.264392 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f88c7487-d6ae-4803-9801-da9401c6ae1c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:37.421002 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f88c7487-d6ae-4803-9801-da9401c6ae1c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:37.429056 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f88c7487-d6ae-4803-9801-da9401c6ae1c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1370 microversion: 2.1 time: 0.184926 Aug 05 02:23:37.442829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 262/524] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:37 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:38.451256 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0dff0f78-ccff-41db-8a19-9d744b7863b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:38.452684 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0dff0f78-ccff-41db-8a19-9d744b7863b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:38.462427 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0dff0f78-ccff-41db-8a19-9d744b7863b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:38.464853 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0dff0f78-ccff-41db-8a19-9d744b7863b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:38.466830 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0dff0f78-ccff-41db-8a19-9d744b7863b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:38.468134 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0dff0f78-ccff-41db-8a19-9d744b7863b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:38.469151 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0dff0f78-ccff-41db-8a19-9d744b7863b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:38.470102 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0dff0f78-ccff-41db-8a19-9d744b7863b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:38.814626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0dff0f78-ccff-41db-8a19-9d744b7863b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:38.827565 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0dff0f78-ccff-41db-8a19-9d744b7863b2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1370 microversion: 2.1 time: 0.380883 Aug 05 02:23:38.844238 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 263/525] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:38 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1370 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:39.846201 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:39.870724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-84b4a329-9c63-4282-a861-c08c9481abf2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:39.872751 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-84b4a329-9c63-4282-a861-c08c9481abf2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:39.880985 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84b4a329-9c63-4282-a861-c08c9481abf2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:39.892929 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84b4a329-9c63-4282-a861-c08c9481abf2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:39.895546 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84b4a329-9c63-4282-a861-c08c9481abf2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:39.896540 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84b4a329-9c63-4282-a861-c08c9481abf2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:39.897155 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84b4a329-9c63-4282-a861-c08c9481abf2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:39.897740 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84b4a329-9c63-4282-a861-c08c9481abf2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:40.076446 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-84b4a329-9c63-4282-a861-c08c9481abf2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:40.084364 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-84b4a329-9c63-4282-a861-c08c9481abf2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1370 microversion: 2.1 time: 0.239287 Aug 05 02:23:40.085325 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 263/526] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:39 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:41.108635 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-11470f5a-e7b7-469d-8166-79c38f05ccaa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:41.109208 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-11470f5a-e7b7-469d-8166-79c38f05ccaa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:41.111142 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:41.112209 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:41.113501 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:41.119547 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-11470f5a-e7b7-469d-8166-79c38f05ccaa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:41.120297 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-11470f5a-e7b7-469d-8166-79c38f05ccaa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:41.120775 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-11470f5a-e7b7-469d-8166-79c38f05ccaa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:41.121755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-11470f5a-e7b7-469d-8166-79c38f05ccaa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:41.122247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-11470f5a-e7b7-469d-8166-79c38f05ccaa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:41.122594 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-11470f5a-e7b7-469d-8166-79c38f05ccaa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:41.302777 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-11470f5a-e7b7-469d-8166-79c38f05ccaa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:41.311218 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-11470f5a-e7b7-469d-8166-79c38f05ccaa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1370 microversion: 2.1 time: 0.206753 Aug 05 02:23:41.312431 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 264/527] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:41 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:41.436443 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-9447bda0-f129-4b9b-8082-a7f0ae5cab49 req-c1c4f049-911f-4a2b-b968-0031493d00f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c37a85-a2b7-4dec-983c-5b65e70c3aa0", "name": "network-vif-plugged", "status": "completed", "tag": "025ccb86-82f0-4646-825e-bf471dd56047"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:23:41.446549 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9447bda0-f129-4b9b-8082-a7f0ae5cab49 req-c1c4f049-911f-4a2b-b968-0031493d00f1 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:41.447298 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9447bda0-f129-4b9b-8082-a7f0ae5cab49 req-c1c4f049-911f-4a2b-b968-0031493d00f1 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:41.447721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9447bda0-f129-4b9b-8082-a7f0ae5cab49 req-c1c4f049-911f-4a2b-b968-0031493d00f1 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:41.460080 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-9447bda0-f129-4b9b-8082-a7f0ae5cab49 req-c1c4f049-911f-4a2b-b968-0031493d00f1 service nova] Creating event network-vif-plugged:025ccb86-82f0-4646-825e-bf471dd56047 for instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 on hv-cinder-81558 Aug 05 02:23:41.469736 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-9447bda0-f129-4b9b-8082-a7f0ae5cab49 req-c1c4f049-911f-4a2b-b968-0031493d00f1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038118 Aug 05 02:23:41.470331 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 264/528] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:23:42.333944 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d8b515f5-22fb-4ea6-9179-322575fe090c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:42.335320 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d8b515f5-22fb-4ea6-9179-322575fe090c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:42.342759 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8b515f5-22fb-4ea6-9179-322575fe090c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:42.343999 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8b515f5-22fb-4ea6-9179-322575fe090c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:42.344717 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8b515f5-22fb-4ea6-9179-322575fe090c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:42.345783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8b515f5-22fb-4ea6-9179-322575fe090c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:42.346273 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8b515f5-22fb-4ea6-9179-322575fe090c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:42.346951 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8b515f5-22fb-4ea6-9179-322575fe090c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:42.503522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d8b515f5-22fb-4ea6-9179-322575fe090c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:42.512684 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d8b515f5-22fb-4ea6-9179-322575fe090c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1370 microversion: 2.1 time: 0.183013 Aug 05 02:23:42.526839 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 265/529] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:42 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:43.535012 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e629ce2-ca70-4e0c-840c-f7221508bde2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:43.536447 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7e629ce2-ca70-4e0c-840c-f7221508bde2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:43.544799 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e629ce2-ca70-4e0c-840c-f7221508bde2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:43.545284 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e629ce2-ca70-4e0c-840c-f7221508bde2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:43.545952 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e629ce2-ca70-4e0c-840c-f7221508bde2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:43.546651 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e629ce2-ca70-4e0c-840c-f7221508bde2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:43.547203 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e629ce2-ca70-4e0c-840c-f7221508bde2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:43.547529 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e629ce2-ca70-4e0c-840c-f7221508bde2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:43.694119 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7e629ce2-ca70-4e0c-840c-f7221508bde2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:43.703960 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7e629ce2-ca70-4e0c-840c-f7221508bde2 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1370 microversion: 2.1 time: 0.173342 Aug 05 02:23:43.720591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 265/530] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:43 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:44.733034 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-187bf631-e144-41b1-a4db-cb009e4c2a0f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:44.734721 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-187bf631-e144-41b1-a4db-cb009e4c2a0f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:44.742749 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-187bf631-e144-41b1-a4db-cb009e4c2a0f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:44.743725 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-187bf631-e144-41b1-a4db-cb009e4c2a0f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:44.744412 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-187bf631-e144-41b1-a4db-cb009e4c2a0f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:44.746993 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-187bf631-e144-41b1-a4db-cb009e4c2a0f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:44.748071 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-187bf631-e144-41b1-a4db-cb009e4c2a0f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:44.749212 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-187bf631-e144-41b1-a4db-cb009e4c2a0f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:44.924074 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-187bf631-e144-41b1-a4db-cb009e4c2a0f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:44.935060 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-187bf631-e144-41b1-a4db-cb009e4c2a0f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1370 microversion: 2.1 time: 0.207218 Aug 05 02:23:44.937184 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 266/531] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:44 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:45.959545 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-01a458dd-e988-4e27-9f4b-7de214470d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:45.960190 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-01a458dd-e988-4e27-9f4b-7de214470d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:45.968533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:45.970741 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01a458dd-e988-4e27-9f4b-7de214470d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:45.971457 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01a458dd-e988-4e27-9f4b-7de214470d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:45.972166 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01a458dd-e988-4e27-9f4b-7de214470d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:45.973216 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01a458dd-e988-4e27-9f4b-7de214470d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:45.974052 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01a458dd-e988-4e27-9f4b-7de214470d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:45.974868 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-01a458dd-e988-4e27-9f4b-7de214470d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:46.129843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-01a458dd-e988-4e27-9f4b-7de214470d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:46.138948 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-01a458dd-e988-4e27-9f4b-7de214470d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1370 microversion: 2.1 time: 0.183956 Aug 05 02:23:46.139564 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 266/532] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:45 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:47.161332 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ab68e0d6-ee71-4af7-9dcf-b791ee5677b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:47.162742 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ab68e0d6-ee71-4af7-9dcf-b791ee5677b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:47.169483 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ab68e0d6-ee71-4af7-9dcf-b791ee5677b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:47.170269 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ab68e0d6-ee71-4af7-9dcf-b791ee5677b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:47.170957 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ab68e0d6-ee71-4af7-9dcf-b791ee5677b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:47.171669 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ab68e0d6-ee71-4af7-9dcf-b791ee5677b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:47.172135 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ab68e0d6-ee71-4af7-9dcf-b791ee5677b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:47.172771 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ab68e0d6-ee71-4af7-9dcf-b791ee5677b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:47.326031 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ab68e0d6-ee71-4af7-9dcf-b791ee5677b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:47.339179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ab68e0d6-ee71-4af7-9dcf-b791ee5677b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1370 microversion: 2.1 time: 0.181830 Aug 05 02:23:47.339865 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 267/533] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:47 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:23:48.361326 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d3fa870e-82e7-410e-be92-f757c6632b8e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:48.361957 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d3fa870e-82e7-410e-be92-f757c6632b8e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:48.368262 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3fa870e-82e7-410e-be92-f757c6632b8e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:48.369133 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3fa870e-82e7-410e-be92-f757c6632b8e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:48.369662 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3fa870e-82e7-410e-be92-f757c6632b8e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:48.370617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3fa870e-82e7-410e-be92-f757c6632b8e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:48.371240 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3fa870e-82e7-410e-be92-f757c6632b8e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:48.371669 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3fa870e-82e7-410e-be92-f757c6632b8e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:48.795354 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d3fa870e-82e7-410e-be92-f757c6632b8e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:48.803050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d3fa870e-82e7-410e-be92-f757c6632b8e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1370 microversion: 2.1 time: 0.445659 Aug 05 02:23:48.803855 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 267/534] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:48 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1370 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:48.921533 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:23:48.922141 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Fri Aug 5 02:23:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:23:49.824592 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-98d74782-385e-4b95-83cf-a7469083851e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:49.825786 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-98d74782-385e-4b95-83cf-a7469083851e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:49.833371 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98d74782-385e-4b95-83cf-a7469083851e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:49.833859 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98d74782-385e-4b95-83cf-a7469083851e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:49.834371 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98d74782-385e-4b95-83cf-a7469083851e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:49.835137 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98d74782-385e-4b95-83cf-a7469083851e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:49.835592 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98d74782-385e-4b95-83cf-a7469083851e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:49.836019 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98d74782-385e-4b95-83cf-a7469083851e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:49.844553 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=65 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:49.972596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-98d74782-385e-4b95-83cf-a7469083851e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:49.980679 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-98d74782-385e-4b95-83cf-a7469083851e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1370 microversion: 2.1 time: 0.160602 Aug 05 02:23:49.992186 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 268/535] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:49 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:51.005545 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aa77dec1-92a8-45f3-b7e8-572726e03438 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:51.006337 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aa77dec1-92a8-45f3-b7e8-572726e03438 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:51.013823 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa77dec1-92a8-45f3-b7e8-572726e03438 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:51.014445 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa77dec1-92a8-45f3-b7e8-572726e03438 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:51.015076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa77dec1-92a8-45f3-b7e8-572726e03438 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:51.015777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa77dec1-92a8-45f3-b7e8-572726e03438 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:51.016234 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa77dec1-92a8-45f3-b7e8-572726e03438 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:51.016774 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa77dec1-92a8-45f3-b7e8-572726e03438 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:51.020826 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=61 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:51.159364 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aa77dec1-92a8-45f3-b7e8-572726e03438 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:23:51.169612 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aa77dec1-92a8-45f3-b7e8-572726e03438 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1564 microversion: 2.1 time: 0.171383 Aug 05 02:23:51.170464 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 268/536] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:23:50 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:23:51.191398 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-86450ee4-7422-42e3-8107-ce72800dedcc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:23:51.192731 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-86450ee4-7422-42e3-8107-ce72800dedcc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:23:51.199542 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86450ee4-7422-42e3-8107-ce72800dedcc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:51.200030 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86450ee4-7422-42e3-8107-ce72800dedcc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:51.200568 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86450ee4-7422-42e3-8107-ce72800dedcc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:51.201723 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86450ee4-7422-42e3-8107-ce72800dedcc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:51.202481 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86450ee4-7422-42e3-8107-ce72800dedcc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:51.203233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86450ee4-7422-42e3-8107-ce72800dedcc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:51.295389 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-86450ee4-7422-42e3-8107-ce72800dedcc tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108563 Aug 05 02:23:51.295973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 269/537] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Aug 5 02:23:51 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:23:52.721334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-eb569aaf-9372-4ab2-8617-d0370185f5b3 req-6d74fa91-e154-44b4-9a0e-29ebd4695608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c37a85-a2b7-4dec-983c-5b65e70c3aa0", "tag": "025ccb86-82f0-4646-825e-bf471dd56047"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:23:52.733222 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-eb569aaf-9372-4ab2-8617-d0370185f5b3 req-6d74fa91-e154-44b4-9a0e-29ebd4695608 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:23:52.733222 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-eb569aaf-9372-4ab2-8617-d0370185f5b3 req-6d74fa91-e154-44b4-9a0e-29ebd4695608 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:23:52.733693 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-eb569aaf-9372-4ab2-8617-d0370185f5b3 req-6d74fa91-e154-44b4-9a0e-29ebd4695608 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:23:52.745856 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-eb569aaf-9372-4ab2-8617-d0370185f5b3 req-6d74fa91-e154-44b4-9a0e-29ebd4695608 service nova] Creating event network-changed:025ccb86-82f0-4646-825e-bf471dd56047 for instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 on hv-cinder-81558 Aug 05 02:23:52.751346 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-eb569aaf-9372-4ab2-8617-d0370185f5b3 req-6d74fa91-e154-44b4-9a0e-29ebd4695608 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033695 Aug 05 02:23:52.755710 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 269/538] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:24:07.099012 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=11 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:07.099661 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=9 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:07.104805 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ff6cdc9a-cd87-437c-a975-d5db825a5c0d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:07.105293 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ff6cdc9a-cd87-437c-a975-d5db825a5c0d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:07.111862 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff6cdc9a-cd87-437c-a975-d5db825a5c0d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:07.112362 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff6cdc9a-cd87-437c-a975-d5db825a5c0d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:07.112788 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff6cdc9a-cd87-437c-a975-d5db825a5c0d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:07.113465 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff6cdc9a-cd87-437c-a975-d5db825a5c0d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:07.113914 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff6cdc9a-cd87-437c-a975-d5db825a5c0d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:07.114333 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff6cdc9a-cd87-437c-a975-d5db825a5c0d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:07.136743 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ff6cdc9a-cd87-437c-a975-d5db825a5c0d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/ips" status: 200 len: 145 microversion: 2.1 time: 0.039128 Aug 05 02:24:07.137290 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 270/539] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Aug 5 02:24:07 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:24:08.757800 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=7 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:08.759043 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=7 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:08.764222 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-658370832", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:24:08.828760 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] validate_networks() for None {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:24:09.148869 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:24:09.149320 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:24:09.149834 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:24:09.150209 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:24:09.151244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:24:09.160672 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:09.161159 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:09.161598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:09.162325 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:09.162811 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:09.163235 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:09.180804 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Getting quotas for project 0dc47ee6310d44d191d6d6df7a8a57b6. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:24:09.185506 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Getting quotas for user ae68a4992e474718ba04e8ccd736fcc5 and project 0dc47ee6310d44d191d6d6df7a8a57b6. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:24:09.196762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:24:09.199659 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:24:09.253405 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c61f5f47-b700-4808-b984-716160a59fc8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497275 Aug 05 02:24:09.254174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 270/540] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:24:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:24:09.265519 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-781d9c52-9f6e-4a6d-8b64-5ca7eb7ac6e8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:09.266140 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-781d9c52-9f6e-4a6d-8b64-5ca7eb7ac6e8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:09.323989 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-781d9c52-9f6e-4a6d-8b64-5ca7eb7ac6e8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:09.330549 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-781d9c52-9f6e-4a6d-8b64-5ca7eb7ac6e8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1214 microversion: 2.1 time: 0.068970 Aug 05 02:24:09.331179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 271/541] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:09 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:09.555960 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3fc0aed9-05ce-4ca3-ae21-8e9543ad9408 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:09.556487 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3fc0aed9-05ce-4ca3-ae21-8e9543ad9408 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:09.564364 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fc0aed9-05ce-4ca3-ae21-8e9543ad9408 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:09.564992 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fc0aed9-05ce-4ca3-ae21-8e9543ad9408 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:09.565446 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fc0aed9-05ce-4ca3-ae21-8e9543ad9408 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:09.566372 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fc0aed9-05ce-4ca3-ae21-8e9543ad9408 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:09.566880 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fc0aed9-05ce-4ca3-ae21-8e9543ad9408 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:09.567344 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fc0aed9-05ce-4ca3-ae21-8e9543ad9408 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:09.593271 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3fc0aed9-05ce-4ca3-ae21-8e9543ad9408 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70/ips" status: 200 len: 149 microversion: 2.1 time: 0.040990 Aug 05 02:24:09.600402 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 271/542] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Aug 5 02:24:09 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:24:10.146978 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f3109e34-bc27-4417-9ba5-ff1c2620ddfc tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5d561a2-5177-4cc1-8784-be0133c81b0f"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:24:10.149354 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f3109e34-bc27-4417-9ba5-ff1c2620ddfc tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:10.155943 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3109e34-bc27-4417-9ba5-ff1c2620ddfc tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:10.156468 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3109e34-bc27-4417-9ba5-ff1c2620ddfc tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:10.156905 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3109e34-bc27-4417-9ba5-ff1c2620ddfc tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:10.157596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3109e34-bc27-4417-9ba5-ff1c2620ddfc tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:10.158052 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3109e34-bc27-4417-9ba5-ff1c2620ddfc tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:10.158476 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3109e34-bc27-4417-9ba5-ff1c2620ddfc tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:10.351224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-130fcc04-4c4f-41b3-bbfa-879a35559c09 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:10.351834 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-130fcc04-4c4f-41b3-bbfa-879a35559c09 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:10.360157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-130fcc04-4c4f-41b3-bbfa-879a35559c09 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:10.360672 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-130fcc04-4c4f-41b3-bbfa-879a35559c09 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:10.361108 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-130fcc04-4c4f-41b3-bbfa-879a35559c09 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:10.361884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-130fcc04-4c4f-41b3-bbfa-879a35559c09 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:10.362239 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-130fcc04-4c4f-41b3-bbfa-879a35559c09 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:10.362658 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-130fcc04-4c4f-41b3-bbfa-879a35559c09 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:10.430547 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-130fcc04-4c4f-41b3-bbfa-879a35559c09 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:10.439114 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-130fcc04-4c4f-41b3-bbfa-879a35559c09 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1266 microversion: 2.1 time: 0.091563 Aug 05 02:24:10.439837 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 272/543] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:10 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:24:10.563658 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f3109e34-bc27-4417-9ba5-ff1c2620ddfc tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "POST /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.420352 Aug 05 02:24:10.564380 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 272/544] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Aug 5 02:24:10 2022] POST /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:24:11.461141 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c5353837-9dbe-41c7-83fe-c5de00d3793e tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:11.461871 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c5353837-9dbe-41c7-83fe-c5de00d3793e tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:11.475674 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5353837-9dbe-41c7-83fe-c5de00d3793e tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:11.476459 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5353837-9dbe-41c7-83fe-c5de00d3793e tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:11.476996 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5353837-9dbe-41c7-83fe-c5de00d3793e tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:11.477954 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5353837-9dbe-41c7-83fe-c5de00d3793e tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:11.478518 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5353837-9dbe-41c7-83fe-c5de00d3793e tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:11.479634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5353837-9dbe-41c7-83fe-c5de00d3793e tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:11.628769 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c5353837-9dbe-41c7-83fe-c5de00d3793e tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:11.639120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c5353837-9dbe-41c7-83fe-c5de00d3793e tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1314 microversion: 2.1 time: 0.182440 Aug 05 02:24:11.640010 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 273/545] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:11 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:12.021602 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2b7175a6-e6d2-4079-9060-f7d3f833035e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf3f2c65-3406-4b9b-803e-f9095c410b4f"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:24:12.024103 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2b7175a6-e6d2-4079-9060-f7d3f833035e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:12.030400 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2b7175a6-e6d2-4079-9060-f7d3f833035e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:12.030862 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2b7175a6-e6d2-4079-9060-f7d3f833035e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:12.031301 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2b7175a6-e6d2-4079-9060-f7d3f833035e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:12.032002 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2b7175a6-e6d2-4079-9060-f7d3f833035e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:12.032534 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2b7175a6-e6d2-4079-9060-f7d3f833035e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:12.032959 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2b7175a6-e6d2-4079-9060-f7d3f833035e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:12.216847 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-61eeb18e-5a03-4dd9-bbdf-d2ed2d342627 req-d9bba043-aaa2-422b-b213-6b15310bb619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "488b034a-2246-4cc2-ae78-658598749cc7", "tag": "62fe0b56-f40f-4e66-b2ae-4660c9f2b7d9"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:24:12.229601 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-61eeb18e-5a03-4dd9-bbdf-d2ed2d342627 req-d9bba043-aaa2-422b-b213-6b15310bb619 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:12.230620 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-61eeb18e-5a03-4dd9-bbdf-d2ed2d342627 req-d9bba043-aaa2-422b-b213-6b15310bb619 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:12.231279 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-61eeb18e-5a03-4dd9-bbdf-d2ed2d342627 req-d9bba043-aaa2-422b-b213-6b15310bb619 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:12.252527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-61eeb18e-5a03-4dd9-bbdf-d2ed2d342627 req-d9bba043-aaa2-422b-b213-6b15310bb619 service nova] Creating event network-changed:62fe0b56-f40f-4e66-b2ae-4660c9f2b7d9 for instance 488b034a-2246-4cc2-ae78-658598749cc7 on hv-cinder-81558 Aug 05 02:24:12.258643 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-61eeb18e-5a03-4dd9-bbdf-d2ed2d342627 req-d9bba043-aaa2-422b-b213-6b15310bb619 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045766 Aug 05 02:24:12.259516 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 274/546] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:24:12.335315 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2b7175a6-e6d2-4079-9060-f7d3f833035e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "POST /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318971 Aug 05 02:24:12.335968 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 273/547] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Aug 5 02:24:12 2022] POST /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:24:12.471881 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7296ea45-4811-491a-9467-b6bbc64c0557 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:12.472638 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7296ea45-4811-491a-9467-b6bbc64c0557 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:12.479008 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7296ea45-4811-491a-9467-b6bbc64c0557 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:12.479642 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7296ea45-4811-491a-9467-b6bbc64c0557 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:12.480149 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7296ea45-4811-491a-9467-b6bbc64c0557 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:12.480939 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7296ea45-4811-491a-9467-b6bbc64c0557 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:12.481467 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7296ea45-4811-491a-9467-b6bbc64c0557 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:12.481965 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7296ea45-4811-491a-9467-b6bbc64c0557 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:12.505541 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7296ea45-4811-491a-9467-b6bbc64c0557 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/ips" status: 200 len: 151 microversion: 2.20 time: 0.038143 Aug 05 02:24:12.506113 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 275/548] 10.222.0.15 () {60 vars in 1289 bytes} [Fri Aug 5 02:24:12 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:24:12.660049 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c2204f87-1327-46f0-9718-dede2b3565ef tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:12.660775 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c2204f87-1327-46f0-9718-dede2b3565ef tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:12.668451 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2204f87-1327-46f0-9718-dede2b3565ef tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:12.669780 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2204f87-1327-46f0-9718-dede2b3565ef tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:12.670531 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2204f87-1327-46f0-9718-dede2b3565ef tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:12.671630 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2204f87-1327-46f0-9718-dede2b3565ef tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:12.672388 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2204f87-1327-46f0-9718-dede2b3565ef tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:12.673001 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c2204f87-1327-46f0-9718-dede2b3565ef tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:12.882895 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c2204f87-1327-46f0-9718-dede2b3565ef tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:12.893359 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c2204f87-1327-46f0-9718-dede2b3565ef tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1314 microversion: 2.1 time: 0.237876 Aug 05 02:24:12.894196 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 274/549] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:12 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:13.914915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4f1c8a16-10d1-42e3-9121-847dd826f6c3 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:13.917118 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4f1c8a16-10d1-42e3-9121-847dd826f6c3 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:13.925205 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f1c8a16-10d1-42e3-9121-847dd826f6c3 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:13.926255 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f1c8a16-10d1-42e3-9121-847dd826f6c3 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:13.926586 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f1c8a16-10d1-42e3-9121-847dd826f6c3 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:13.927284 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f1c8a16-10d1-42e3-9121-847dd826f6c3 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:13.927745 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f1c8a16-10d1-42e3-9121-847dd826f6c3 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:13.928355 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f1c8a16-10d1-42e3-9121-847dd826f6c3 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:14.062573 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4f1c8a16-10d1-42e3-9121-847dd826f6c3 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:14.071178 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4f1c8a16-10d1-42e3-9121-847dd826f6c3 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1314 microversion: 2.1 time: 0.159912 Aug 05 02:24:14.071638 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 276/550] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:13 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:14.468228 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a19d5673-c63a-45de-a437-added80b4d48 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:24:14.468795 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a19d5673-c63a-45de-a437-added80b4d48 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:14.475114 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a19d5673-c63a-45de-a437-added80b4d48 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:14.475600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a19d5673-c63a-45de-a437-added80b4d48 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:14.476041 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a19d5673-c63a-45de-a437-added80b4d48 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:14.476750 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a19d5673-c63a-45de-a437-added80b4d48 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:14.477202 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a19d5673-c63a-45de-a437-added80b4d48 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:14.477629 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a19d5673-c63a-45de-a437-added80b4d48 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:14.502545 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-a19d5673-c63a-45de-a437-added80b4d48 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lazy-loading 'flavor' on Instance uuid 319a8a64-7b50-4fff-93b6-4498b53265ab {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:24:14.677502 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a19d5673-c63a-45de-a437-added80b4d48 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "POST /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/action" status: 202 len: 0 microversion: 2.20 time: 0.213183 Aug 05 02:24:14.678131 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 275/551] 10.222.0.15 () {62 vars in 1319 bytes} [Fri Aug 5 02:24:14 2022] POST /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:24:14.687166 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-85f1a0b7-55de-41a2-90d4-1058a4c1e1aa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:14.687767 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-85f1a0b7-55de-41a2-90d4-1058a4c1e1aa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:14.693603 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85f1a0b7-55de-41a2-90d4-1058a4c1e1aa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:14.694080 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85f1a0b7-55de-41a2-90d4-1058a4c1e1aa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:14.694512 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85f1a0b7-55de-41a2-90d4-1058a4c1e1aa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:14.695189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85f1a0b7-55de-41a2-90d4-1058a4c1e1aa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:14.695636 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85f1a0b7-55de-41a2-90d4-1058a4c1e1aa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:14.696054 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85f1a0b7-55de-41a2-90d4-1058a4c1e1aa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:14.838698 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-85f1a0b7-55de-41a2-90d4-1058a4c1e1aa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:14.853405 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-85f1a0b7-55de-41a2-90d4-1058a4c1e1aa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:14.855100 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-85f1a0b7-55de-41a2-90d4-1058a4c1e1aa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:14.856298 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-85f1a0b7-55de-41a2-90d4-1058a4c1e1aa tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.172958 Aug 05 02:24:14.856909 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 277/552] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:14 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:15.094183 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-aef33892-52dd-4812-a560-2762dae3be16 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:15.094861 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-aef33892-52dd-4812-a560-2762dae3be16 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:15.105894 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aef33892-52dd-4812-a560-2762dae3be16 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:15.106659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aef33892-52dd-4812-a560-2762dae3be16 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:15.107119 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aef33892-52dd-4812-a560-2762dae3be16 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:15.107821 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aef33892-52dd-4812-a560-2762dae3be16 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:15.108286 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aef33892-52dd-4812-a560-2762dae3be16 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:15.108742 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-aef33892-52dd-4812-a560-2762dae3be16 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:15.239038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-aef33892-52dd-4812-a560-2762dae3be16 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:15.247619 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-aef33892-52dd-4812-a560-2762dae3be16 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1314 microversion: 2.1 time: 0.158347 Aug 05 02:24:15.248705 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 276/553] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:15 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:15.880535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-369c7fd1-0ef9-4877-8178-d47061b0d5b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:15.881181 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-369c7fd1-0ef9-4877-8178-d47061b0d5b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:15.887784 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-369c7fd1-0ef9-4877-8178-d47061b0d5b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:15.888273 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-369c7fd1-0ef9-4877-8178-d47061b0d5b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:15.888730 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-369c7fd1-0ef9-4877-8178-d47061b0d5b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:15.889428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-369c7fd1-0ef9-4877-8178-d47061b0d5b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:15.889881 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-369c7fd1-0ef9-4877-8178-d47061b0d5b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:15.890301 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-369c7fd1-0ef9-4877-8178-d47061b0d5b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:16.024549 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-369c7fd1-0ef9-4877-8178-d47061b0d5b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:16.033238 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-369c7fd1-0ef9-4877-8178-d47061b0d5b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:16.034742 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-369c7fd1-0ef9-4877-8178-d47061b0d5b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:16.035885 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-369c7fd1-0ef9-4877-8178-d47061b0d5b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.159661 Aug 05 02:24:16.036456 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 278/554] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:15 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:16.270346 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-709dc632-1b2d-4a24-bd53-fea9856aa6ed tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:16.270977 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-709dc632-1b2d-4a24-bd53-fea9856aa6ed tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:16.278117 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-709dc632-1b2d-4a24-bd53-fea9856aa6ed tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:16.278591 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-709dc632-1b2d-4a24-bd53-fea9856aa6ed tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:16.279020 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-709dc632-1b2d-4a24-bd53-fea9856aa6ed tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:16.279699 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-709dc632-1b2d-4a24-bd53-fea9856aa6ed tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:16.280143 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-709dc632-1b2d-4a24-bd53-fea9856aa6ed tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:16.280585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-709dc632-1b2d-4a24-bd53-fea9856aa6ed tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:16.459590 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-709dc632-1b2d-4a24-bd53-fea9856aa6ed tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:16.468084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-709dc632-1b2d-4a24-bd53-fea9856aa6ed tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1314 microversion: 2.1 time: 0.201503 Aug 05 02:24:16.468676 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 277/555] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:16 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:17.059581 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3733444b-6187-4b95-a039-d6c17bee05ce tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:17.060212 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3733444b-6187-4b95-a039-d6c17bee05ce tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:17.066594 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3733444b-6187-4b95-a039-d6c17bee05ce tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:17.067081 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3733444b-6187-4b95-a039-d6c17bee05ce tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:17.067519 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3733444b-6187-4b95-a039-d6c17bee05ce tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:17.068211 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3733444b-6187-4b95-a039-d6c17bee05ce tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:17.068695 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3733444b-6187-4b95-a039-d6c17bee05ce tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:17.069124 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3733444b-6187-4b95-a039-d6c17bee05ce tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:17.203835 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3733444b-6187-4b95-a039-d6c17bee05ce tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:17.211677 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3733444b-6187-4b95-a039-d6c17bee05ce tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:17.213167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3733444b-6187-4b95-a039-d6c17bee05ce tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:17.214523 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3733444b-6187-4b95-a039-d6c17bee05ce tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.159283 Aug 05 02:24:17.214848 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 279/556] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:17 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:17.488869 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-eac6a07b-a722-46fc-a998-f600685d5c5c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:17.489629 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-eac6a07b-a722-46fc-a998-f600685d5c5c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:17.496809 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eac6a07b-a722-46fc-a998-f600685d5c5c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:17.497512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eac6a07b-a722-46fc-a998-f600685d5c5c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:17.498065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eac6a07b-a722-46fc-a998-f600685d5c5c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:17.498886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eac6a07b-a722-46fc-a998-f600685d5c5c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:17.499417 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eac6a07b-a722-46fc-a998-f600685d5c5c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:17.499908 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-eac6a07b-a722-46fc-a998-f600685d5c5c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:17.629334 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-eac6a07b-a722-46fc-a998-f600685d5c5c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:17.636911 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-eac6a07b-a722-46fc-a998-f600685d5c5c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1314 microversion: 2.1 time: 0.151811 Aug 05 02:24:17.637469 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 278/557] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:17 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:18.236938 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6ae86b9a-166e-4351-8445-38fefa9b7440 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:18.237553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6ae86b9a-166e-4351-8445-38fefa9b7440 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:18.243887 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ae86b9a-166e-4351-8445-38fefa9b7440 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:18.244380 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ae86b9a-166e-4351-8445-38fefa9b7440 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:18.244809 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ae86b9a-166e-4351-8445-38fefa9b7440 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:18.246135 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ae86b9a-166e-4351-8445-38fefa9b7440 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:18.246608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ae86b9a-166e-4351-8445-38fefa9b7440 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:18.247020 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6ae86b9a-166e-4351-8445-38fefa9b7440 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:18.384880 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6ae86b9a-166e-4351-8445-38fefa9b7440 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:18.393307 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6ae86b9a-166e-4351-8445-38fefa9b7440 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:18.394800 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6ae86b9a-166e-4351-8445-38fefa9b7440 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:18.395928 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6ae86b9a-166e-4351-8445-38fefa9b7440 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.162873 Aug 05 02:24:18.396497 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 280/558] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:18 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:18.657544 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f539a5b4-525a-4743-8e32-8f4cb677c705 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:18.658176 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f539a5b4-525a-4743-8e32-8f4cb677c705 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:18.664533 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f539a5b4-525a-4743-8e32-8f4cb677c705 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:18.665016 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f539a5b4-525a-4743-8e32-8f4cb677c705 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:18.665451 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f539a5b4-525a-4743-8e32-8f4cb677c705 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:18.666134 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f539a5b4-525a-4743-8e32-8f4cb677c705 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:18.666587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f539a5b4-525a-4743-8e32-8f4cb677c705 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:18.667051 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f539a5b4-525a-4743-8e32-8f4cb677c705 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:18.815872 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f539a5b4-525a-4743-8e32-8f4cb677c705 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:18.823602 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f539a5b4-525a-4743-8e32-8f4cb677c705 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1314 microversion: 2.1 time: 0.169545 Aug 05 02:24:18.824225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 279/559] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:18 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:19.189108 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1bab6e5e-35bf-4730-bdc5-2b955a5a0279 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:24:19.191093 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:19.192902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:19.197512 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bab6e5e-35bf-4730-bdc5-2b955a5a0279 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:19.197988 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bab6e5e-35bf-4730-bdc5-2b955a5a0279 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:19.198969 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bab6e5e-35bf-4730-bdc5-2b955a5a0279 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:19.258655 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1bab6e5e-35bf-4730-bdc5-2b955a5a0279 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Going to try to stop instance {{(pid=117920) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 02:24:19.302043 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1bab6e5e-35bf-4730-bdc5-2b955a5a0279 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "POST /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/action" status: 202 len: 0 microversion: 2.1 time: 0.116495 Aug 05 02:24:19.302800 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 281/560] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Aug 5 02:24:19 2022] POST /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:24:19.311811 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9292c371-6b2f-4e20-a379-a260ba8981aa tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:19.312519 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9292c371-6b2f-4e20-a379-a260ba8981aa tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:19.318678 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9292c371-6b2f-4e20-a379-a260ba8981aa tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:19.319147 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9292c371-6b2f-4e20-a379-a260ba8981aa tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:19.319652 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9292c371-6b2f-4e20-a379-a260ba8981aa tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:19.320440 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9292c371-6b2f-4e20-a379-a260ba8981aa tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:19.320922 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9292c371-6b2f-4e20-a379-a260ba8981aa tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:19.321390 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9292c371-6b2f-4e20-a379-a260ba8981aa tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:19.328169 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:19.419446 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c7c02a91-d9e9-4a04-ac10-fdc40b457a6b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:19.420138 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c7c02a91-d9e9-4a04-ac10-fdc40b457a6b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:19.426339 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7c02a91-d9e9-4a04-ac10-fdc40b457a6b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:19.426817 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7c02a91-d9e9-4a04-ac10-fdc40b457a6b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:19.427246 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7c02a91-d9e9-4a04-ac10-fdc40b457a6b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:19.427929 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7c02a91-d9e9-4a04-ac10-fdc40b457a6b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:19.428395 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7c02a91-d9e9-4a04-ac10-fdc40b457a6b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:19.428815 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7c02a91-d9e9-4a04-ac10-fdc40b457a6b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:19.466129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9292c371-6b2f-4e20-a379-a260ba8981aa tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:19.474868 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9292c371-6b2f-4e20-a379-a260ba8981aa tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1721 microversion: 2.1 time: 0.167286 Aug 05 02:24:19.475892 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 280/561] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:19 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:19.588229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c7c02a91-d9e9-4a04-ac10-fdc40b457a6b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:19.598536 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c7c02a91-d9e9-4a04-ac10-fdc40b457a6b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:19.600035 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c7c02a91-d9e9-4a04-ac10-fdc40b457a6b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:19.601233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c7c02a91-d9e9-4a04-ac10-fdc40b457a6b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.185965 Aug 05 02:24:19.601814 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 282/562] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:19 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:24:19.844657 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-64f30ae1-0b09-47df-940d-4b841ed7e022 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:19.845366 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-64f30ae1-0b09-47df-940d-4b841ed7e022 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:19.851991 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-64f30ae1-0b09-47df-940d-4b841ed7e022 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:19.852521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-64f30ae1-0b09-47df-940d-4b841ed7e022 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:19.853029 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-64f30ae1-0b09-47df-940d-4b841ed7e022 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:19.853704 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-64f30ae1-0b09-47df-940d-4b841ed7e022 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:19.854651 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-64f30ae1-0b09-47df-940d-4b841ed7e022 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:19.854651 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-64f30ae1-0b09-47df-940d-4b841ed7e022 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:19.986914 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-64f30ae1-0b09-47df-940d-4b841ed7e022 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:20.000109 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-64f30ae1-0b09-47df-940d-4b841ed7e022 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1314 microversion: 2.1 time: 0.159767 Aug 05 02:24:20.000727 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 281/563] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:19 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:20.180099 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-3f7adab9-79c6-4ca6-9904-67fd2d18d41e req-4e6a5c65-d3a9-4b56-8a24-1a6f55b0afb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "488b034a-2246-4cc2-ae78-658598749cc7", "name": "network-vif-plugged", "status": "completed", "tag": "62fe0b56-f40f-4e66-b2ae-4660c9f2b7d9"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:24:20.190743 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3f7adab9-79c6-4ca6-9904-67fd2d18d41e req-4e6a5c65-d3a9-4b56-8a24-1a6f55b0afb1 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:20.191219 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3f7adab9-79c6-4ca6-9904-67fd2d18d41e req-4e6a5c65-d3a9-4b56-8a24-1a6f55b0afb1 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:20.191638 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3f7adab9-79c6-4ca6-9904-67fd2d18d41e req-4e6a5c65-d3a9-4b56-8a24-1a6f55b0afb1 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:20.202750 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-3f7adab9-79c6-4ca6-9904-67fd2d18d41e req-4e6a5c65-d3a9-4b56-8a24-1a6f55b0afb1 service nova] Creating event network-vif-plugged:62fe0b56-f40f-4e66-b2ae-4660c9f2b7d9 for instance 488b034a-2246-4cc2-ae78-658598749cc7 on hv-cinder-81558 Aug 05 02:24:20.207410 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-3f7adab9-79c6-4ca6-9904-67fd2d18d41e req-4e6a5c65-d3a9-4b56-8a24-1a6f55b0afb1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030926 Aug 05 02:24:20.208113 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 283/564] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:24:20.496349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9ca9b68b-a7bd-4805-8e21-2a922b388572 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:20.496975 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9ca9b68b-a7bd-4805-8e21-2a922b388572 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:20.502780 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9ca9b68b-a7bd-4805-8e21-2a922b388572 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:20.503261 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9ca9b68b-a7bd-4805-8e21-2a922b388572 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:20.503695 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9ca9b68b-a7bd-4805-8e21-2a922b388572 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:20.504398 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9ca9b68b-a7bd-4805-8e21-2a922b388572 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:20.504853 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9ca9b68b-a7bd-4805-8e21-2a922b388572 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:20.505288 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9ca9b68b-a7bd-4805-8e21-2a922b388572 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:20.624270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-26f7ee4f-1fcc-4796-9ca8-eafa069bda6a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:20.624861 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-26f7ee4f-1fcc-4796-9ca8-eafa069bda6a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:20.630746 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26f7ee4f-1fcc-4796-9ca8-eafa069bda6a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:20.631217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26f7ee4f-1fcc-4796-9ca8-eafa069bda6a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:20.631839 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26f7ee4f-1fcc-4796-9ca8-eafa069bda6a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:20.632553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26f7ee4f-1fcc-4796-9ca8-eafa069bda6a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:20.633001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26f7ee4f-1fcc-4796-9ca8-eafa069bda6a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:20.640207 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-26f7ee4f-1fcc-4796-9ca8-eafa069bda6a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:20.641814 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9ca9b68b-a7bd-4805-8e21-2a922b388572 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:20.650004 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9ca9b68b-a7bd-4805-8e21-2a922b388572 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1721 microversion: 2.1 time: 0.157625 Aug 05 02:24:20.650569 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 282/565] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:20 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:20.771685 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-26f7ee4f-1fcc-4796-9ca8-eafa069bda6a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:20.779964 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-26f7ee4f-1fcc-4796-9ca8-eafa069bda6a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:20.781506 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-26f7ee4f-1fcc-4796-9ca8-eafa069bda6a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:20.782647 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-26f7ee4f-1fcc-4796-9ca8-eafa069bda6a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.163469 Aug 05 02:24:20.783189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 284/566] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:20 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:24:21.020092 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e5e81851-e7ba-4b60-8b72-49da3dec426c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:21.020670 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e5e81851-e7ba-4b60-8b72-49da3dec426c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:21.027830 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5e81851-e7ba-4b60-8b72-49da3dec426c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:21.028305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5e81851-e7ba-4b60-8b72-49da3dec426c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:21.028755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5e81851-e7ba-4b60-8b72-49da3dec426c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:21.029432 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5e81851-e7ba-4b60-8b72-49da3dec426c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:21.029875 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5e81851-e7ba-4b60-8b72-49da3dec426c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:21.030288 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5e81851-e7ba-4b60-8b72-49da3dec426c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:21.034094 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:21.167511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e5e81851-e7ba-4b60-8b72-49da3dec426c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:21.175002 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e5e81851-e7ba-4b60-8b72-49da3dec426c tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1314 microversion: 2.1 time: 0.158833 Aug 05 02:24:21.175570 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 283/567] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:21 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:21.671419 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0581f146-16ad-47c2-b66f-293a5ea6cb3d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:21.672027 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0581f146-16ad-47c2-b66f-293a5ea6cb3d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:21.678274 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0581f146-16ad-47c2-b66f-293a5ea6cb3d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:21.678751 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0581f146-16ad-47c2-b66f-293a5ea6cb3d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:21.679186 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0581f146-16ad-47c2-b66f-293a5ea6cb3d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:21.679869 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0581f146-16ad-47c2-b66f-293a5ea6cb3d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:21.680570 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0581f146-16ad-47c2-b66f-293a5ea6cb3d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:21.680973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0581f146-16ad-47c2-b66f-293a5ea6cb3d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:21.805544 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-162817e4-ae76-41b1-99b3-8d3c648dada9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:21.806139 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-162817e4-ae76-41b1-99b3-8d3c648dada9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:21.812618 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-162817e4-ae76-41b1-99b3-8d3c648dada9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:21.813099 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-162817e4-ae76-41b1-99b3-8d3c648dada9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:21.813523 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-162817e4-ae76-41b1-99b3-8d3c648dada9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:21.814201 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-162817e4-ae76-41b1-99b3-8d3c648dada9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:21.814604 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0581f146-16ad-47c2-b66f-293a5ea6cb3d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:21.814737 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-162817e4-ae76-41b1-99b3-8d3c648dada9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:21.815054 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-162817e4-ae76-41b1-99b3-8d3c648dada9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:21.822529 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0581f146-16ad-47c2-b66f-293a5ea6cb3d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1721 microversion: 2.1 time: 0.155474 Aug 05 02:24:21.823147 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 285/568] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:21 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:21.957686 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-162817e4-ae76-41b1-99b3-8d3c648dada9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:21.965969 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-162817e4-ae76-41b1-99b3-8d3c648dada9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:21.967719 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-162817e4-ae76-41b1-99b3-8d3c648dada9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:21.968899 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-162817e4-ae76-41b1-99b3-8d3c648dada9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.167249 Aug 05 02:24:21.969457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 284/569] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:21 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:24:22.195944 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-17404534-0070-44de-bc74-21090c88f0f9 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:22.196573 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-17404534-0070-44de-bc74-21090c88f0f9 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:22.202532 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17404534-0070-44de-bc74-21090c88f0f9 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:22.203016 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17404534-0070-44de-bc74-21090c88f0f9 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:22.203478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17404534-0070-44de-bc74-21090c88f0f9 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:22.204167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17404534-0070-44de-bc74-21090c88f0f9 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:22.204646 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17404534-0070-44de-bc74-21090c88f0f9 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:22.205071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17404534-0070-44de-bc74-21090c88f0f9 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:22.333670 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-17404534-0070-44de-bc74-21090c88f0f9 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:22.341691 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-17404534-0070-44de-bc74-21090c88f0f9 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1314 microversion: 2.1 time: 0.149604 Aug 05 02:24:22.342501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 286/570] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:22 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:22.844682 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9e3a37c6-226f-4ebb-acb9-13445c2786f8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:22.845285 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9e3a37c6-226f-4ebb-acb9-13445c2786f8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:22.851604 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e3a37c6-226f-4ebb-acb9-13445c2786f8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:22.852078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e3a37c6-226f-4ebb-acb9-13445c2786f8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:22.852674 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e3a37c6-226f-4ebb-acb9-13445c2786f8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:22.853387 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e3a37c6-226f-4ebb-acb9-13445c2786f8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:22.853835 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e3a37c6-226f-4ebb-acb9-13445c2786f8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:22.854859 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e3a37c6-226f-4ebb-acb9-13445c2786f8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:22.992717 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e89262f1-b0b9-49b4-9b6a-6e31cda2bb03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:22.993337 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e89262f1-b0b9-49b4-9b6a-6e31cda2bb03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:22.999988 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e89262f1-b0b9-49b4-9b6a-6e31cda2bb03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:23.000595 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e89262f1-b0b9-49b4-9b6a-6e31cda2bb03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:23.001111 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e89262f1-b0b9-49b4-9b6a-6e31cda2bb03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:23.001617 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9e3a37c6-226f-4ebb-acb9-13445c2786f8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:23.001952 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e89262f1-b0b9-49b4-9b6a-6e31cda2bb03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:23.002477 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e89262f1-b0b9-49b4-9b6a-6e31cda2bb03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:23.002976 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e89262f1-b0b9-49b4-9b6a-6e31cda2bb03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:23.015100 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9e3a37c6-226f-4ebb-acb9-13445c2786f8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1721 microversion: 2.1 time: 0.175440 Aug 05 02:24:23.024404 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 285/571] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:22 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:23.136914 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e89262f1-b0b9-49b4-9b6a-6e31cda2bb03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:23.144933 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e89262f1-b0b9-49b4-9b6a-6e31cda2bb03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:23.146421 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e89262f1-b0b9-49b4-9b6a-6e31cda2bb03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:23.147568 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e89262f1-b0b9-49b4-9b6a-6e31cda2bb03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.158805 Aug 05 02:24:23.148127 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 287/572] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:22 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:24:23.362350 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cb8304bc-1c2f-441b-86ad-3349774c928f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:23.362869 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cb8304bc-1c2f-441b-86ad-3349774c928f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:23.368752 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cb8304bc-1c2f-441b-86ad-3349774c928f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:23.369237 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cb8304bc-1c2f-441b-86ad-3349774c928f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:23.369667 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cb8304bc-1c2f-441b-86ad-3349774c928f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:23.371196 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cb8304bc-1c2f-441b-86ad-3349774c928f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:23.371657 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cb8304bc-1c2f-441b-86ad-3349774c928f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:23.372083 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cb8304bc-1c2f-441b-86ad-3349774c928f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:23.503156 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cb8304bc-1c2f-441b-86ad-3349774c928f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:23.511129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cb8304bc-1c2f-441b-86ad-3349774c928f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1464 microversion: 2.1 time: 0.152065 Aug 05 02:24:23.511690 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 286/573] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:23 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:23.565040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-93480fd0-808c-4993-86fc-7e9bb2a81f5f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:23.565534 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-93480fd0-808c-4993-86fc-7e9bb2a81f5f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:23.571533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93480fd0-808c-4993-86fc-7e9bb2a81f5f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:23.572034 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93480fd0-808c-4993-86fc-7e9bb2a81f5f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:23.572512 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93480fd0-808c-4993-86fc-7e9bb2a81f5f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:23.574207 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93480fd0-808c-4993-86fc-7e9bb2a81f5f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:23.574444 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93480fd0-808c-4993-86fc-7e9bb2a81f5f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:23.574862 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93480fd0-808c-4993-86fc-7e9bb2a81f5f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:23.578771 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:23.602184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-93480fd0-808c-4993-86fc-7e9bb2a81f5f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:24:23.674933 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-93480fd0-808c-4993-86fc-7e9bb2a81f5f tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "DELETE /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 204 len: 0 microversion: 2.1 time: 0.113944 Aug 05 02:24:23.675506 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 288/574] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:24:23 2022] DELETE /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:24:23.685834 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6cac1489-2593-4835-822d-07bf853e30c6 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:23.686448 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6cac1489-2593-4835-822d-07bf853e30c6 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:23.692178 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6cac1489-2593-4835-822d-07bf853e30c6 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:23.692682 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6cac1489-2593-4835-822d-07bf853e30c6 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:23.693109 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6cac1489-2593-4835-822d-07bf853e30c6 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:23.693783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6cac1489-2593-4835-822d-07bf853e30c6 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:23.694226 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6cac1489-2593-4835-822d-07bf853e30c6 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:23.694637 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6cac1489-2593-4835-822d-07bf853e30c6 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:23.824294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6cac1489-2593-4835-822d-07bf853e30c6 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:23.836059 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6cac1489-2593-4835-822d-07bf853e30c6 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1470 microversion: 2.1 time: 0.155955 Aug 05 02:24:23.836838 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 287/575] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:23 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:24.038216 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-633b7961-2a70-41a4-be5f-a2f71ab6eef1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:24.039068 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-633b7961-2a70-41a4-be5f-a2f71ab6eef1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:24.046739 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-633b7961-2a70-41a4-be5f-a2f71ab6eef1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:24.047227 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-633b7961-2a70-41a4-be5f-a2f71ab6eef1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:24.047661 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-633b7961-2a70-41a4-be5f-a2f71ab6eef1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:24.048376 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-633b7961-2a70-41a4-be5f-a2f71ab6eef1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:24.048830 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-633b7961-2a70-41a4-be5f-a2f71ab6eef1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:24.049256 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-633b7961-2a70-41a4-be5f-a2f71ab6eef1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:24.177443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-356244f8-85aa-4fad-ad47-b841cc681037 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:24.178089 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-356244f8-85aa-4fad-ad47-b841cc681037 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:24.184835 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-356244f8-85aa-4fad-ad47-b841cc681037 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:24.185320 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-356244f8-85aa-4fad-ad47-b841cc681037 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:24.185751 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-356244f8-85aa-4fad-ad47-b841cc681037 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:24.186447 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-356244f8-85aa-4fad-ad47-b841cc681037 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:24.186899 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-356244f8-85aa-4fad-ad47-b841cc681037 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:24.187319 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-356244f8-85aa-4fad-ad47-b841cc681037 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:24.189746 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-633b7961-2a70-41a4-be5f-a2f71ab6eef1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:24.197508 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-633b7961-2a70-41a4-be5f-a2f71ab6eef1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1721 microversion: 2.1 time: 0.163506 Aug 05 02:24:24.198233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 289/576] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:24 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:24.320058 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-356244f8-85aa-4fad-ad47-b841cc681037 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:24.327923 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-356244f8-85aa-4fad-ad47-b841cc681037 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:24.329436 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-356244f8-85aa-4fad-ad47-b841cc681037 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:24.330571 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-356244f8-85aa-4fad-ad47-b841cc681037 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.157057 Aug 05 02:24:24.331121 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 288/577] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:24 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:24.858218 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-87501e58-63cc-4239-b6ef-25af9da4f626 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:24.858830 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-87501e58-63cc-4239-b6ef-25af9da4f626 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:24.864905 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87501e58-63cc-4239-b6ef-25af9da4f626 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:24.865391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87501e58-63cc-4239-b6ef-25af9da4f626 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:24.865831 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87501e58-63cc-4239-b6ef-25af9da4f626 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:24.866522 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87501e58-63cc-4239-b6ef-25af9da4f626 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:24.866978 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87501e58-63cc-4239-b6ef-25af9da4f626 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:24.867404 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87501e58-63cc-4239-b6ef-25af9da4f626 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:24.993738 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-87501e58-63cc-4239-b6ef-25af9da4f626 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:25.001814 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-87501e58-63cc-4239-b6ef-25af9da4f626 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1470 microversion: 2.1 time: 0.147557 Aug 05 02:24:25.002374 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 290/578] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:24 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:25.218613 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0dd5dfb5-8d56-40a7-be08-f80a5ea9c65a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:25.219211 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0dd5dfb5-8d56-40a7-be08-f80a5ea9c65a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:25.225551 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0dd5dfb5-8d56-40a7-be08-f80a5ea9c65a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:25.226018 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0dd5dfb5-8d56-40a7-be08-f80a5ea9c65a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:25.226467 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0dd5dfb5-8d56-40a7-be08-f80a5ea9c65a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:25.227134 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0dd5dfb5-8d56-40a7-be08-f80a5ea9c65a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:25.227611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0dd5dfb5-8d56-40a7-be08-f80a5ea9c65a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:25.228013 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0dd5dfb5-8d56-40a7-be08-f80a5ea9c65a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:25.353744 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cdc65f7b-c591-46e3-8257-efe8c3d5bc26 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:25.354877 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cdc65f7b-c591-46e3-8257-efe8c3d5bc26 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:25.356530 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0dd5dfb5-8d56-40a7-be08-f80a5ea9c65a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:25.361530 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cdc65f7b-c591-46e3-8257-efe8c3d5bc26 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:25.362016 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cdc65f7b-c591-46e3-8257-efe8c3d5bc26 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:25.362449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cdc65f7b-c591-46e3-8257-efe8c3d5bc26 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:25.363168 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cdc65f7b-c591-46e3-8257-efe8c3d5bc26 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:25.363816 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cdc65f7b-c591-46e3-8257-efe8c3d5bc26 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:25.364241 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cdc65f7b-c591-46e3-8257-efe8c3d5bc26 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:25.364574 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0dd5dfb5-8d56-40a7-be08-f80a5ea9c65a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1721 microversion: 2.1 time: 0.150080 Aug 05 02:24:25.365132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 289/579] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:25 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:25.498257 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cdc65f7b-c591-46e3-8257-efe8c3d5bc26 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:25.506123 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cdc65f7b-c591-46e3-8257-efe8c3d5bc26 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:25.507595 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cdc65f7b-c591-46e3-8257-efe8c3d5bc26 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:25.508759 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cdc65f7b-c591-46e3-8257-efe8c3d5bc26 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.159244 Aug 05 02:24:25.509303 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 291/580] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:25 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:24:26.023335 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b0756cba-5304-4654-934f-2c5f12aed1c1 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:26.023932 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b0756cba-5304-4654-934f-2c5f12aed1c1 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:26.030458 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b0756cba-5304-4654-934f-2c5f12aed1c1 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:26.030933 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b0756cba-5304-4654-934f-2c5f12aed1c1 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:26.031362 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b0756cba-5304-4654-934f-2c5f12aed1c1 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:26.032035 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b0756cba-5304-4654-934f-2c5f12aed1c1 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:26.032506 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b0756cba-5304-4654-934f-2c5f12aed1c1 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:26.032921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b0756cba-5304-4654-934f-2c5f12aed1c1 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:26.160714 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b0756cba-5304-4654-934f-2c5f12aed1c1 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:26.167995 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b0756cba-5304-4654-934f-2c5f12aed1c1 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1470 microversion: 2.1 time: 0.148440 Aug 05 02:24:26.168601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 290/581] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:26 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:26.386898 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-171d85d5-dd45-4c9a-b72a-703d33a7f20d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:26.387443 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-171d85d5-dd45-4c9a-b72a-703d33a7f20d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:26.393432 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-171d85d5-dd45-4c9a-b72a-703d33a7f20d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:26.393907 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-171d85d5-dd45-4c9a-b72a-703d33a7f20d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:26.394335 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-171d85d5-dd45-4c9a-b72a-703d33a7f20d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:26.395006 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-171d85d5-dd45-4c9a-b72a-703d33a7f20d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:26.395452 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-171d85d5-dd45-4c9a-b72a-703d33a7f20d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:26.395868 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-171d85d5-dd45-4c9a-b72a-703d33a7f20d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:26.528974 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-171d85d5-dd45-4c9a-b72a-703d33a7f20d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:26.532268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fbe66863-1c8f-449b-916c-22f178593988 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:26.532880 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fbe66863-1c8f-449b-916c-22f178593988 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:26.537555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-171d85d5-dd45-4c9a-b72a-703d33a7f20d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1721 microversion: 2.1 time: 0.154637 Aug 05 02:24:26.538118 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 292/582] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:26 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:26.539054 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fbe66863-1c8f-449b-916c-22f178593988 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:26.539529 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fbe66863-1c8f-449b-916c-22f178593988 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:26.539957 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fbe66863-1c8f-449b-916c-22f178593988 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:26.540663 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fbe66863-1c8f-449b-916c-22f178593988 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:26.541106 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fbe66863-1c8f-449b-916c-22f178593988 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:26.542153 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fbe66863-1c8f-449b-916c-22f178593988 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:26.680154 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fbe66863-1c8f-449b-916c-22f178593988 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:26.688541 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fbe66863-1c8f-449b-916c-22f178593988 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:26.691646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fbe66863-1c8f-449b-916c-22f178593988 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:26.691646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fbe66863-1c8f-449b-916c-22f178593988 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.162833 Aug 05 02:24:26.691890 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 291/583] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:26 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:27.189247 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b9cce2b5-5eed-4d84-977f-502cabfbe194 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:27.189804 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b9cce2b5-5eed-4d84-977f-502cabfbe194 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:27.195854 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9cce2b5-5eed-4d84-977f-502cabfbe194 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:27.196350 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9cce2b5-5eed-4d84-977f-502cabfbe194 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:27.196784 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9cce2b5-5eed-4d84-977f-502cabfbe194 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:27.197467 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9cce2b5-5eed-4d84-977f-502cabfbe194 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:27.198684 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9cce2b5-5eed-4d84-977f-502cabfbe194 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:27.199109 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9cce2b5-5eed-4d84-977f-502cabfbe194 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:27.362355 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b9cce2b5-5eed-4d84-977f-502cabfbe194 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:27.372444 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b9cce2b5-5eed-4d84-977f-502cabfbe194 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1470 microversion: 2.1 time: 0.186965 Aug 05 02:24:27.373015 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 293/584] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:27 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1470 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:27.559595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-15c3ff05-b26c-4556-b6d7-ca89b9e962d0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:27.560379 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-15c3ff05-b26c-4556-b6d7-ca89b9e962d0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:27.566776 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15c3ff05-b26c-4556-b6d7-ca89b9e962d0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:27.567357 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15c3ff05-b26c-4556-b6d7-ca89b9e962d0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:27.567782 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15c3ff05-b26c-4556-b6d7-ca89b9e962d0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:27.568503 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15c3ff05-b26c-4556-b6d7-ca89b9e962d0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:27.568962 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15c3ff05-b26c-4556-b6d7-ca89b9e962d0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:27.569380 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-15c3ff05-b26c-4556-b6d7-ca89b9e962d0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:27.714028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-168d4504-b157-4c2b-98ef-68c9b1d69819 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:27.714712 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-168d4504-b157-4c2b-98ef-68c9b1d69819 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:27.721303 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-168d4504-b157-4c2b-98ef-68c9b1d69819 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:27.721783 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-168d4504-b157-4c2b-98ef-68c9b1d69819 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:27.722213 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-168d4504-b157-4c2b-98ef-68c9b1d69819 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:27.722895 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-168d4504-b157-4c2b-98ef-68c9b1d69819 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:27.723399 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-168d4504-b157-4c2b-98ef-68c9b1d69819 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:27.723756 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-168d4504-b157-4c2b-98ef-68c9b1d69819 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:27.852434 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-15c3ff05-b26c-4556-b6d7-ca89b9e962d0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:27.859962 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-168d4504-b157-4c2b-98ef-68c9b1d69819 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:27.862039 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-15c3ff05-b26c-4556-b6d7-ca89b9e962d0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1721 microversion: 2.1 time: 0.306849 Aug 05 02:24:27.862617 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 292/585] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:27 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1721 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:27.868403 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-168d4504-b157-4c2b-98ef-68c9b1d69819 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:27.871286 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-168d4504-b157-4c2b-98ef-68c9b1d69819 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:27.872512 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-168d4504-b157-4c2b-98ef-68c9b1d69819 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.162449 Aug 05 02:24:27.873461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 294/586] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:27 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:24:28.161273 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-3b73c5cb-8430-4b66-81b0-41c0fc71f5c8 req-6fd7920a-10af-468a-867a-4627bfb204a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "488b034a-2246-4cc2-ae78-658598749cc7", "name": "network-vif-deleted", "tag": "62fe0b56-f40f-4e66-b2ae-4660c9f2b7d9"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:24:28.175415 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-3b73c5cb-8430-4b66-81b0-41c0fc71f5c8 req-6fd7920a-10af-468a-867a-4627bfb204a3 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:28.176105 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-3b73c5cb-8430-4b66-81b0-41c0fc71f5c8 req-6fd7920a-10af-468a-867a-4627bfb204a3 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:28.176564 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-3b73c5cb-8430-4b66-81b0-41c0fc71f5c8 req-6fd7920a-10af-468a-867a-4627bfb204a3 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:28.188711 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-3b73c5cb-8430-4b66-81b0-41c0fc71f5c8 req-6fd7920a-10af-468a-867a-4627bfb204a3 service nova] Creating event network-vif-deleted:62fe0b56-f40f-4e66-b2ae-4660c9f2b7d9 for instance 488b034a-2246-4cc2-ae78-658598749cc7 on hv-cinder-81558 Aug 05 02:24:28.194244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-3b73c5cb-8430-4b66-81b0-41c0fc71f5c8 req-6fd7920a-10af-468a-867a-4627bfb204a3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036706 Aug 05 02:24:28.195805 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 293/587] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:24:28.398861 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-727a8f7d-2aec-43ec-9c83-4dd096b0dbeb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Action: 'create', calling method: .version_select at 0x7fa65c6e0310>, body: {"keypair": {"name": "tempest-keypair-2089784729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEljuiDme76zDqm2XuQSwN5GXRyb1htB3Imvz7yLR/ikih2dqjMdyBKDFBz1sohxupWm3yZYUGMuv4Vn3dTqggpVMp6NlbalOfld6I9XYS9Hl7l5JtmxvSBopTGFM2wLCA=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:24:28.399255 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bfd39363-96d7-4801-91af-572023c68ae8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:28.399954 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bfd39363-96d7-4801-91af-572023c68ae8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:28.407661 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bfd39363-96d7-4801-91af-572023c68ae8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:28.408146 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bfd39363-96d7-4801-91af-572023c68ae8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:28.408611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bfd39363-96d7-4801-91af-572023c68ae8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:28.409305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bfd39363-96d7-4801-91af-572023c68ae8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:28.409945 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bfd39363-96d7-4801-91af-572023c68ae8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:28.410356 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bfd39363-96d7-4801-91af-572023c68ae8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:28.417367 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-727a8f7d-2aec-43ec-9c83-4dd096b0dbeb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Getting quotas for project ad6a220b99d94a648150476bf0a01e50. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:24:28.421860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-727a8f7d-2aec-43ec-9c83-4dd096b0dbeb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Getting quotas for user 600f51be8202427fb3691db566ed2ff2 and project ad6a220b99d94a648150476bf0a01e50. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:24:28.442920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bfd39363-96d7-4801-91af-572023c68ae8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:28.443431 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bfd39363-96d7-4801-91af-572023c68ae8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:28.443866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bfd39363-96d7-4801-91af-572023c68ae8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:28.444348 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-bfd39363-96d7-4801-91af-572023c68ae8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lazy-loading 'fault' on Instance uuid 488b034a-2246-4cc2-ae78-658598749cc7 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:24:28.448397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-727a8f7d-2aec-43ec-9c83-4dd096b0dbeb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052924 Aug 05 02:24:28.448993 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 295/588] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Aug 5 02:24:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:24:28.492465 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bfd39363-96d7-4801-91af-572023c68ae8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae68a4992e474718ba04e8ccd736fcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc47ee6310d44d191d6d6df7a8a57b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:28.500030 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bfd39363-96d7-4801-91af-572023c68ae8 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 200 len: 1304 microversion: 2.1 time: 0.104807 Aug 05 02:24:28.500550 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 294/589] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:28 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:28.883551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-64d0ea95-c5f0-46d7-b908-c569673f094d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:28.884162 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-64d0ea95-c5f0-46d7-b908-c569673f094d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:28.890764 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64d0ea95-c5f0-46d7-b908-c569673f094d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:28.891510 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64d0ea95-c5f0-46d7-b908-c569673f094d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:28.891954 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64d0ea95-c5f0-46d7-b908-c569673f094d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:28.892683 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64d0ea95-c5f0-46d7-b908-c569673f094d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:28.893143 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64d0ea95-c5f0-46d7-b908-c569673f094d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:28.893567 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-64d0ea95-c5f0-46d7-b908-c569673f094d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:28.896803 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2253752f-3cf8-485d-b545-e22165a878c4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:28.897616 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2253752f-3cf8-485d-b545-e22165a878c4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:28.904401 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2253752f-3cf8-485d-b545-e22165a878c4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:28.905162 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2253752f-3cf8-485d-b545-e22165a878c4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:28.905664 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2253752f-3cf8-485d-b545-e22165a878c4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:28.906431 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2253752f-3cf8-485d-b545-e22165a878c4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:28.906985 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2253752f-3cf8-485d-b545-e22165a878c4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:28.907495 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2253752f-3cf8-485d-b545-e22165a878c4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:29.028945 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-64d0ea95-c5f0-46d7-b908-c569673f094d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:29.038512 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-64d0ea95-c5f0-46d7-b908-c569673f094d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1721 microversion: 2.1 time: 0.159120 Aug 05 02:24:29.039057 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 296/590] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:28 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:29.138924 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2253752f-3cf8-485d-b545-e22165a878c4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:29.149540 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2253752f-3cf8-485d-b545-e22165a878c4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:29.152014 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2253752f-3cf8-485d-b545-e22165a878c4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:29.154153 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2253752f-3cf8-485d-b545-e22165a878c4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.261401 Aug 05 02:24:29.168881 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 295/591] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:28 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:24:29.521262 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-07e42310-ee5e-4a0c-a757-b7f519f92320 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:29.521796 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-07e42310-ee5e-4a0c-a757-b7f519f92320 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] [instance: 488b034a-2246-4cc2-ae78-658598749cc7] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:29.528708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07e42310-ee5e-4a0c-a757-b7f519f92320 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:29.529195 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07e42310-ee5e-4a0c-a757-b7f519f92320 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:29.529632 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07e42310-ee5e-4a0c-a757-b7f519f92320 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:29.530338 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07e42310-ee5e-4a0c-a757-b7f519f92320 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:29.530799 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07e42310-ee5e-4a0c-a757-b7f519f92320 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:29.531217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-07e42310-ee5e-4a0c-a757-b7f519f92320 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:29.546860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-07e42310-ee5e-4a0c-a757-b7f519f92320 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] HTTP exception thrown: Instance 488b034a-2246-4cc2-ae78-658598749cc7 could not be found. Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-07e42310-ee5e-4a0c-a757-b7f519f92320 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Request method failure captured: Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 HTTP/1.1 Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H9EkEzzA0x0MUMKxUFCyML0bULdflkdiAl2jfF87E3CsvCiVPB7KjWinwhjpAmGs9NAhgLLM2dXvnOM5USYqCnlafPljT4zEaeZ0Tv-FW_tTtnxc_U9-f7_OcCZowHJd_BpMxsIA7rqT6MDzP8rD0QTW9EC0se88_kqBe9q0WOZGoo Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 0dc47ee6310d44d191d6d6df7a8a57b6 Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-1878112619 Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:24:29.548454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:24:29.550071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0dc47ee6310d44d191d6d6df7a8a57b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0dc47ee6310d44d191d6d6df7a8a57b6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0dc47ee6310d44d191d6d6df7a8a57b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0dc47ee6310d44d191d6d6df7a8a57b6"}]}] Aug 05 02:24:29.550071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-1878112619 Aug 05 02:24:29.550071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 0dc47ee6310d44d191d6d6df7a8a57b6 Aug 05 02:24:29.550071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-1878112619 Aug 05 02:24:29.550071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-1878112619-project Aug 05 02:24:29.550071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:24:29.550071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:24:29.550071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: ae68a4992e474718ba04e8ccd736fcc5 Aug 05 02:24:29.550071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-1878112619-project Aug 05 02:24:29.550071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:24:29.550071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 488b034a-2246-4cc2-ae78-658598749cc7 could not be found. Aug 05 02:24:29.550071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '488b034a-2246-4cc2-ae78-658598749cc7'} Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488b034a-2246-4cc2-ae78-658598749cc7 could not be found. Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:24:29.551036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488b034a-2246-4cc2-ae78-658598749cc7 could not be found. Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488b034a-2246-4cc2-ae78-658598749cc7 could not be found. Aug 05 02:24:29.552591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:24:29.553737 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-07e42310-ee5e-4a0c-a757-b7f519f92320 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] Returning 404 to user: Instance 488b034a-2246-4cc2-ae78-658598749cc7 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:24:29.553737 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-07e42310-ee5e-4a0c-a757-b7f519f92320 tempest-VolumesNegativeTest-1878112619 tempest-VolumesNegativeTest-1878112619-project] 10.222.0.15 "GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7" status: 404 len: 111 microversion: 2.1 time: 0.032632 Aug 05 02:24:29.553737 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 297/592] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:29 2022] GET /compute/v2.1/servers/488b034a-2246-4cc2-ae78-658598749cc7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:24:29.977658 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1758728398", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "528bd4e2-8ce2-403c-8a20-be166348ecb8"}], "security_groups": [{"name": "tempest-securitygroup--1192166505"}], "key_name": "tempest-keypair-2089784729", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:24:30.070228 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2a897e74-0122-4a63-a5e9-1fba533983c7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:30.071419 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2a897e74-0122-4a63-a5e9-1fba533983c7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:30.081158 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a897e74-0122-4a63-a5e9-1fba533983c7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:30.081717 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a897e74-0122-4a63-a5e9-1fba533983c7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:30.082249 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a897e74-0122-4a63-a5e9-1fba533983c7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:30.083018 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a897e74-0122-4a63-a5e9-1fba533983c7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:30.083553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a897e74-0122-4a63-a5e9-1fba533983c7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:30.084045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a897e74-0122-4a63-a5e9-1fba533983c7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:30.093761 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] validate_networks() for [('528bd4e2-8ce2-403c-8a20-be166348ecb8', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:24:30.234440 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2a897e74-0122-4a63-a5e9-1fba533983c7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:30.247526 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2a897e74-0122-4a63-a5e9-1fba533983c7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1721 microversion: 2.1 time: 0.182024 Aug 05 02:24:30.250794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 298/593] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:30 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:30.255193 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-36a6276d-78c2-4e46-8d58-e483cbc261dc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:30.255844 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-36a6276d-78c2-4e46-8d58-e483cbc261dc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:30.267995 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36a6276d-78c2-4e46-8d58-e483cbc261dc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:30.268531 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36a6276d-78c2-4e46-8d58-e483cbc261dc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:30.268967 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36a6276d-78c2-4e46-8d58-e483cbc261dc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:30.269737 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36a6276d-78c2-4e46-8d58-e483cbc261dc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:30.270189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36a6276d-78c2-4e46-8d58-e483cbc261dc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:30.270608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36a6276d-78c2-4e46-8d58-e483cbc261dc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:30.411382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-36a6276d-78c2-4e46-8d58-e483cbc261dc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:30.420814 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-36a6276d-78c2-4e46-8d58-e483cbc261dc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:30.423046 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-36a6276d-78c2-4e46-8d58-e483cbc261dc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:30.424300 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-36a6276d-78c2-4e46-8d58-e483cbc261dc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.172644 Aug 05 02:24:30.431907 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 299/594] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:30 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:30.515694 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:24:30.516192 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:24:30.516824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:24:30.517460 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:24:30.517958 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:24:30.527901 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:30.528517 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:30.529022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:30.529812 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:30.530358 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:30.530856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:30.549370 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Getting quotas for project ad6a220b99d94a648150476bf0a01e50. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:24:30.553415 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Getting quotas for user 600f51be8202427fb3691db566ed2ff2 and project ad6a220b99d94a648150476bf0a01e50. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:24:30.565956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:24:30.568224 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:24:30.614870 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6ecf4b6b-35b5-4fb0-8a32-d2053c58aa45 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.641365 Aug 05 02:24:30.616464 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 296/595] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:24:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:24:30.626310 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-940cdfda-e4b9-4347-b6a6-5d8d8fcd1086 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:30.626913 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-940cdfda-e4b9-4347-b6a6-5d8d8fcd1086 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:30.682853 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-940cdfda-e4b9-4347-b6a6-5d8d8fcd1086 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:30.690343 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-940cdfda-e4b9-4347-b6a6-5d8d8fcd1086 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1242 microversion: 2.1 time: 0.067680 Aug 05 02:24:30.690933 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 300/596] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:30 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:31.271770 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ab8dd17a-ee50-4156-8d30-c494daae4bbf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:31.272408 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ab8dd17a-ee50-4156-8d30-c494daae4bbf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:31.281750 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ab8dd17a-ee50-4156-8d30-c494daae4bbf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:31.281868 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ab8dd17a-ee50-4156-8d30-c494daae4bbf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:31.282228 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ab8dd17a-ee50-4156-8d30-c494daae4bbf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:31.282996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ab8dd17a-ee50-4156-8d30-c494daae4bbf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:31.283337 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ab8dd17a-ee50-4156-8d30-c494daae4bbf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:31.283753 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ab8dd17a-ee50-4156-8d30-c494daae4bbf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:31.431661 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ab8dd17a-ee50-4156-8d30-c494daae4bbf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:31.440296 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ab8dd17a-ee50-4156-8d30-c494daae4bbf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1721 microversion: 2.1 time: 0.172842 Aug 05 02:24:31.440943 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 297/597] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:31 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:31.452503 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a0f04382-cbd8-408a-a233-6e5737b2988e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:31.452503 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a0f04382-cbd8-408a-a233-6e5737b2988e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:31.455073 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0f04382-cbd8-408a-a233-6e5737b2988e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:31.455558 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0f04382-cbd8-408a-a233-6e5737b2988e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:31.455992 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0f04382-cbd8-408a-a233-6e5737b2988e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:31.456716 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0f04382-cbd8-408a-a233-6e5737b2988e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:31.457169 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0f04382-cbd8-408a-a233-6e5737b2988e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:31.457588 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0f04382-cbd8-408a-a233-6e5737b2988e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:31.594676 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a0f04382-cbd8-408a-a233-6e5737b2988e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:31.604778 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a0f04382-cbd8-408a-a233-6e5737b2988e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:31.606495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a0f04382-cbd8-408a-a233-6e5737b2988e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:31.607919 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a0f04382-cbd8-408a-a233-6e5737b2988e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.164553 Aug 05 02:24:31.608610 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 301/598] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:31 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:24:31.711235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f15c8e60-f85a-434d-82bf-b8eea44e41c2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:31.711874 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f15c8e60-f85a-434d-82bf-b8eea44e41c2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:31.718567 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f15c8e60-f85a-434d-82bf-b8eea44e41c2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:31.719051 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f15c8e60-f85a-434d-82bf-b8eea44e41c2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:31.719483 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f15c8e60-f85a-434d-82bf-b8eea44e41c2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:31.720178 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f15c8e60-f85a-434d-82bf-b8eea44e41c2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:31.720683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f15c8e60-f85a-434d-82bf-b8eea44e41c2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:31.721116 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f15c8e60-f85a-434d-82bf-b8eea44e41c2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:31.789260 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f15c8e60-f85a-434d-82bf-b8eea44e41c2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:31.797327 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f15c8e60-f85a-434d-82bf-b8eea44e41c2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1294 microversion: 2.1 time: 0.089916 Aug 05 02:24:31.797970 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 298/599] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:31 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:32.466462 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f572db59-2e2e-47bd-97b3-917d02c586e7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:32.467504 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f572db59-2e2e-47bd-97b3-917d02c586e7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:32.474575 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f572db59-2e2e-47bd-97b3-917d02c586e7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:32.475154 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f572db59-2e2e-47bd-97b3-917d02c586e7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:32.475812 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f572db59-2e2e-47bd-97b3-917d02c586e7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:32.476814 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f572db59-2e2e-47bd-97b3-917d02c586e7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:32.477338 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f572db59-2e2e-47bd-97b3-917d02c586e7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:32.477829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f572db59-2e2e-47bd-97b3-917d02c586e7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:32.623217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f572db59-2e2e-47bd-97b3-917d02c586e7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:32.634092 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8301e84c-73eb-45cb-a72a-6db951905214 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:32.634829 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8301e84c-73eb-45cb-a72a-6db951905214 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:32.648582 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f572db59-2e2e-47bd-97b3-917d02c586e7 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1721 microversion: 2.1 time: 0.183707 Aug 05 02:24:32.650213 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8301e84c-73eb-45cb-a72a-6db951905214 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:32.652018 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 302/600] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:32 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:32.654358 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8301e84c-73eb-45cb-a72a-6db951905214 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:32.655037 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8301e84c-73eb-45cb-a72a-6db951905214 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:32.656004 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8301e84c-73eb-45cb-a72a-6db951905214 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:32.656557 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8301e84c-73eb-45cb-a72a-6db951905214 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:32.657060 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8301e84c-73eb-45cb-a72a-6db951905214 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:32.818301 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f708175d-73fe-4f10-aadf-b5e13badedd6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:32.818828 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f708175d-73fe-4f10-aadf-b5e13badedd6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:32.822035 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:32.826298 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f708175d-73fe-4f10-aadf-b5e13badedd6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:32.826946 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f708175d-73fe-4f10-aadf-b5e13badedd6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:32.827232 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f708175d-73fe-4f10-aadf-b5e13badedd6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:32.828306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f708175d-73fe-4f10-aadf-b5e13badedd6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:32.828947 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f708175d-73fe-4f10-aadf-b5e13badedd6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:32.829573 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f708175d-73fe-4f10-aadf-b5e13badedd6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:32.889483 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8301e84c-73eb-45cb-a72a-6db951905214 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:32.897699 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8301e84c-73eb-45cb-a72a-6db951905214 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:32.899449 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8301e84c-73eb-45cb-a72a-6db951905214 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:32.901419 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8301e84c-73eb-45cb-a72a-6db951905214 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.270615 Aug 05 02:24:32.902529 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 299/601] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:32 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:24:33.006275 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f708175d-73fe-4f10-aadf-b5e13badedd6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:33.017262 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f708175d-73fe-4f10-aadf-b5e13badedd6 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1368 microversion: 2.1 time: 0.203073 Aug 05 02:24:33.018402 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 303/602] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:32 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:24:33.459269 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-fdf2407e-f33c-4b24-a387-47f52a09afdf req-d0bc8df9-c7d5-47e6-b6e6-dc4b5e16a1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "184f7bdb-49dd-4b9c-864d-e07bdb888d6c", "tag": "9106f29f-cfec-4c3a-9817-3041bd272f04"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:24:33.470154 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-fdf2407e-f33c-4b24-a387-47f52a09afdf req-d0bc8df9-c7d5-47e6-b6e6-dc4b5e16a1c7 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:33.470631 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-fdf2407e-f33c-4b24-a387-47f52a09afdf req-d0bc8df9-c7d5-47e6-b6e6-dc4b5e16a1c7 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:33.471053 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-fdf2407e-f33c-4b24-a387-47f52a09afdf req-d0bc8df9-c7d5-47e6-b6e6-dc4b5e16a1c7 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:33.482737 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-fdf2407e-f33c-4b24-a387-47f52a09afdf req-d0bc8df9-c7d5-47e6-b6e6-dc4b5e16a1c7 service nova] Creating event network-changed:9106f29f-cfec-4c3a-9817-3041bd272f04 for instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c on hv-cinder-81558 Aug 05 02:24:33.487810 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-fdf2407e-f33c-4b24-a387-47f52a09afdf req-d0bc8df9-c7d5-47e6-b6e6-dc4b5e16a1c7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032167 Aug 05 02:24:33.488591 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 300/603] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:24:33.671697 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1ac012af-883a-4fca-a09f-685d9f99b4c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:33.672248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1ac012af-883a-4fca-a09f-685d9f99b4c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:33.679213 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ac012af-883a-4fca-a09f-685d9f99b4c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:33.679698 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ac012af-883a-4fca-a09f-685d9f99b4c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:33.680138 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ac012af-883a-4fca-a09f-685d9f99b4c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:33.680866 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ac012af-883a-4fca-a09f-685d9f99b4c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:33.681324 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ac012af-883a-4fca-a09f-685d9f99b4c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:33.682387 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ac012af-883a-4fca-a09f-685d9f99b4c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:33.816473 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1ac012af-883a-4fca-a09f-685d9f99b4c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:33.826866 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1ac012af-883a-4fca-a09f-685d9f99b4c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1721 microversion: 2.1 time: 0.159060 Aug 05 02:24:33.827442 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 304/604] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:33 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:24:33.927737 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8d261169-84ea-4cbd-a6c9-3526d53c303a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:33.928765 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8d261169-84ea-4cbd-a6c9-3526d53c303a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:33.935310 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d261169-84ea-4cbd-a6c9-3526d53c303a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:33.936115 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d261169-84ea-4cbd-a6c9-3526d53c303a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:33.936649 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d261169-84ea-4cbd-a6c9-3526d53c303a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:33.937408 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d261169-84ea-4cbd-a6c9-3526d53c303a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:33.938031 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d261169-84ea-4cbd-a6c9-3526d53c303a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:33.938460 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8d261169-84ea-4cbd-a6c9-3526d53c303a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:33.958816 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:34.043839 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-89d473e0-2f1e-4e7a-9cd1-b00d8c36238f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:34.044584 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-89d473e0-2f1e-4e7a-9cd1-b00d8c36238f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:34.050800 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89d473e0-2f1e-4e7a-9cd1-b00d8c36238f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:34.051574 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89d473e0-2f1e-4e7a-9cd1-b00d8c36238f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:34.052229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89d473e0-2f1e-4e7a-9cd1-b00d8c36238f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:34.053018 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89d473e0-2f1e-4e7a-9cd1-b00d8c36238f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:34.053535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89d473e0-2f1e-4e7a-9cd1-b00d8c36238f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:34.054168 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89d473e0-2f1e-4e7a-9cd1-b00d8c36238f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:34.153932 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8d261169-84ea-4cbd-a6c9-3526d53c303a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:34.162131 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8d261169-84ea-4cbd-a6c9-3526d53c303a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:34.163618 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8d261169-84ea-4cbd-a6c9-3526d53c303a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:34.164814 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8d261169-84ea-4cbd-a6c9-3526d53c303a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.242332 Aug 05 02:24:34.165460 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 301/605] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:33 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:34.232578 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-89d473e0-2f1e-4e7a-9cd1-b00d8c36238f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:34.235963 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:34.240948 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-89d473e0-2f1e-4e7a-9cd1-b00d8c36238f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1368 microversion: 2.1 time: 0.201870 Aug 05 02:24:34.241511 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 305/606] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:34 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:24:34.848934 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a72a9429-9300-42ee-97ed-7ae0319ccf90 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:34.849533 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a72a9429-9300-42ee-97ed-7ae0319ccf90 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:34.855489 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a72a9429-9300-42ee-97ed-7ae0319ccf90 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:34.855950 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a72a9429-9300-42ee-97ed-7ae0319ccf90 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:34.856421 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a72a9429-9300-42ee-97ed-7ae0319ccf90 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:34.857093 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a72a9429-9300-42ee-97ed-7ae0319ccf90 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:34.857534 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a72a9429-9300-42ee-97ed-7ae0319ccf90 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:34.857952 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a72a9429-9300-42ee-97ed-7ae0319ccf90 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:34.992431 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a72a9429-9300-42ee-97ed-7ae0319ccf90 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:35.000926 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a72a9429-9300-42ee-97ed-7ae0319ccf90 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1721 microversion: 2.1 time: 0.155888 Aug 05 02:24:35.001483 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 302/607] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:34 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:35.189172 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c63edb96-7945-4c97-b820-22653530bf00 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:35.189795 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c63edb96-7945-4c97-b820-22653530bf00 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:35.196852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c63edb96-7945-4c97-b820-22653530bf00 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:35.197343 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c63edb96-7945-4c97-b820-22653530bf00 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:35.197809 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c63edb96-7945-4c97-b820-22653530bf00 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:35.198489 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c63edb96-7945-4c97-b820-22653530bf00 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:35.198935 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c63edb96-7945-4c97-b820-22653530bf00 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:35.199351 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c63edb96-7945-4c97-b820-22653530bf00 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:35.261375 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d02080e3-beb9-48a2-b017-e865dbe2a2f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:35.261975 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d02080e3-beb9-48a2-b017-e865dbe2a2f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:35.267652 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d02080e3-beb9-48a2-b017-e865dbe2a2f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:35.268127 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d02080e3-beb9-48a2-b017-e865dbe2a2f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:35.268590 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d02080e3-beb9-48a2-b017-e865dbe2a2f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:35.269265 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d02080e3-beb9-48a2-b017-e865dbe2a2f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:35.269707 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d02080e3-beb9-48a2-b017-e865dbe2a2f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:35.270127 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d02080e3-beb9-48a2-b017-e865dbe2a2f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:35.332402 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c63edb96-7945-4c97-b820-22653530bf00 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:35.340396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c63edb96-7945-4c97-b820-22653530bf00 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:35.342157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c63edb96-7945-4c97-b820-22653530bf00 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:35.343436 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c63edb96-7945-4c97-b820-22653530bf00 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.158865 Aug 05 02:24:35.343993 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 306/608] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:35 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:35.402069 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d02080e3-beb9-48a2-b017-e865dbe2a2f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:35.409397 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d02080e3-beb9-48a2-b017-e865dbe2a2f5 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1368 microversion: 2.1 time: 0.152154 Aug 05 02:24:35.409961 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 303/609] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:35 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:24:36.021450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1ada3974-9f26-41ae-88f4-e32843986fd6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:36.022051 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1ada3974-9f26-41ae-88f4-e32843986fd6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:36.028968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ada3974-9f26-41ae-88f4-e32843986fd6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:36.029486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ada3974-9f26-41ae-88f4-e32843986fd6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:36.029924 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ada3974-9f26-41ae-88f4-e32843986fd6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:36.030651 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ada3974-9f26-41ae-88f4-e32843986fd6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:36.031136 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ada3974-9f26-41ae-88f4-e32843986fd6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:36.031573 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ada3974-9f26-41ae-88f4-e32843986fd6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:36.160786 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1ada3974-9f26-41ae-88f4-e32843986fd6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:36.169094 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1ada3974-9f26-41ae-88f4-e32843986fd6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1721 microversion: 2.1 time: 0.151454 Aug 05 02:24:36.169650 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 307/610] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:36 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:36.367385 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-db87d4c9-e830-40f6-a11c-54caf14c361b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:36.368018 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-db87d4c9-e830-40f6-a11c-54caf14c361b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:36.375104 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db87d4c9-e830-40f6-a11c-54caf14c361b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:36.375577 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db87d4c9-e830-40f6-a11c-54caf14c361b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:36.376025 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db87d4c9-e830-40f6-a11c-54caf14c361b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:36.376729 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db87d4c9-e830-40f6-a11c-54caf14c361b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:36.377174 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db87d4c9-e830-40f6-a11c-54caf14c361b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:36.377589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db87d4c9-e830-40f6-a11c-54caf14c361b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:36.430864 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-06c287c6-c5f9-40ab-8e2c-d8a2fedc0384 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:36.431496 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-06c287c6-c5f9-40ab-8e2c-d8a2fedc0384 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:36.438406 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-06c287c6-c5f9-40ab-8e2c-d8a2fedc0384 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:36.438886 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-06c287c6-c5f9-40ab-8e2c-d8a2fedc0384 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:36.439315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-06c287c6-c5f9-40ab-8e2c-d8a2fedc0384 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:36.440002 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-06c287c6-c5f9-40ab-8e2c-d8a2fedc0384 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:36.440476 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-06c287c6-c5f9-40ab-8e2c-d8a2fedc0384 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:36.440895 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-06c287c6-c5f9-40ab-8e2c-d8a2fedc0384 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:36.518382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-db87d4c9-e830-40f6-a11c-54caf14c361b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:36.529412 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-db87d4c9-e830-40f6-a11c-54caf14c361b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:36.531373 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-db87d4c9-e830-40f6-a11c-54caf14c361b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:36.533140 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-db87d4c9-e830-40f6-a11c-54caf14c361b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.169757 Aug 05 02:24:36.533803 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 304/611] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:36 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:36.577958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-06c287c6-c5f9-40ab-8e2c-d8a2fedc0384 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:36.585403 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-06c287c6-c5f9-40ab-8e2c-d8a2fedc0384 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1368 microversion: 2.1 time: 0.158420 Aug 05 02:24:36.585964 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 308/612] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:36 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:24:37.190703 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b4b012da-0441-4975-a7c7-4fb9f88f28c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:37.191368 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b4b012da-0441-4975-a7c7-4fb9f88f28c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:37.193569 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:37.199314 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4b012da-0441-4975-a7c7-4fb9f88f28c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:37.199797 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4b012da-0441-4975-a7c7-4fb9f88f28c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:37.200224 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4b012da-0441-4975-a7c7-4fb9f88f28c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:37.200942 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4b012da-0441-4975-a7c7-4fb9f88f28c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:37.201392 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4b012da-0441-4975-a7c7-4fb9f88f28c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:37.201810 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b4b012da-0441-4975-a7c7-4fb9f88f28c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:37.330677 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b4b012da-0441-4975-a7c7-4fb9f88f28c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:37.339085 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b4b012da-0441-4975-a7c7-4fb9f88f28c1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1721 microversion: 2.1 time: 0.152498 Aug 05 02:24:37.339638 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 305/613] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:37 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:37.556689 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-59ea2dd6-7f8a-4f9f-863e-141c892d1ac3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:37.557368 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-59ea2dd6-7f8a-4f9f-863e-141c892d1ac3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:37.563689 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59ea2dd6-7f8a-4f9f-863e-141c892d1ac3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:37.564173 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59ea2dd6-7f8a-4f9f-863e-141c892d1ac3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:37.564628 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59ea2dd6-7f8a-4f9f-863e-141c892d1ac3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:37.565313 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59ea2dd6-7f8a-4f9f-863e-141c892d1ac3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:37.565764 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59ea2dd6-7f8a-4f9f-863e-141c892d1ac3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:37.566177 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59ea2dd6-7f8a-4f9f-863e-141c892d1ac3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:37.607378 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c6aed600-3645-482d-a593-b366e417038b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:37.607975 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c6aed600-3645-482d-a593-b366e417038b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:37.614214 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6aed600-3645-482d-a593-b366e417038b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:37.614692 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6aed600-3645-482d-a593-b366e417038b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:37.615117 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6aed600-3645-482d-a593-b366e417038b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:37.615800 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6aed600-3645-482d-a593-b366e417038b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:37.616241 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6aed600-3645-482d-a593-b366e417038b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:37.616683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6aed600-3645-482d-a593-b366e417038b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:37.698315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-59ea2dd6-7f8a-4f9f-863e-141c892d1ac3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:37.706576 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-59ea2dd6-7f8a-4f9f-863e-141c892d1ac3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:37.708081 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-59ea2dd6-7f8a-4f9f-863e-141c892d1ac3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:37.709267 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-59ea2dd6-7f8a-4f9f-863e-141c892d1ac3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.156543 Aug 05 02:24:37.709826 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 309/614] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:37 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:37.746644 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c6aed600-3645-482d-a593-b366e417038b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:37.753879 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c6aed600-3645-482d-a593-b366e417038b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1368 microversion: 2.1 time: 0.150693 Aug 05 02:24:37.754503 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 306/615] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:37 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:24:38.358019 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-9b2d7ce0-f3ad-4bde-b885-8aab264e7c7d req-917c92b9-8b75-4b77-b17a-5b6f2f90ff51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319a8a64-7b50-4fff-93b6-4498b53265ab", "name": "network-vif-plugged", "status": "completed", "tag": "661635b8-8836-4704-91ee-343c5d3a40eb"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:24:38.362635 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-47d23cd8-dab0-4131-b62b-ec3244662a09 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:38.363714 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-47d23cd8-dab0-4131-b62b-ec3244662a09 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:38.370899 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9b2d7ce0-f3ad-4bde-b885-8aab264e7c7d req-917c92b9-8b75-4b77-b17a-5b6f2f90ff51 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:38.371382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9b2d7ce0-f3ad-4bde-b885-8aab264e7c7d req-917c92b9-8b75-4b77-b17a-5b6f2f90ff51 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:38.371606 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47d23cd8-dab0-4131-b62b-ec3244662a09 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:38.371958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9b2d7ce0-f3ad-4bde-b885-8aab264e7c7d req-917c92b9-8b75-4b77-b17a-5b6f2f90ff51 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:38.372737 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47d23cd8-dab0-4131-b62b-ec3244662a09 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:38.373373 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47d23cd8-dab0-4131-b62b-ec3244662a09 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:38.374269 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47d23cd8-dab0-4131-b62b-ec3244662a09 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:38.374914 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47d23cd8-dab0-4131-b62b-ec3244662a09 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:38.376400 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47d23cd8-dab0-4131-b62b-ec3244662a09 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:38.385232 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-9b2d7ce0-f3ad-4bde-b885-8aab264e7c7d req-917c92b9-8b75-4b77-b17a-5b6f2f90ff51 service nova] Creating event network-vif-plugged:661635b8-8836-4704-91ee-343c5d3a40eb for instance 319a8a64-7b50-4fff-93b6-4498b53265ab on hv-cinder-81558 Aug 05 02:24:38.390685 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-9b2d7ce0-f3ad-4bde-b885-8aab264e7c7d req-917c92b9-8b75-4b77-b17a-5b6f2f90ff51 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037441 Aug 05 02:24:38.391736 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 310/616] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:24:38.580875 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-47d23cd8-dab0-4131-b62b-ec3244662a09 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:38.592374 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-47d23cd8-dab0-4131-b62b-ec3244662a09 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1698 microversion: 2.1 time: 0.234877 Aug 05 02:24:38.593183 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 307/617] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:38 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1698 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:38.615789 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9d0ec6f2-e735-4b55-8f5c-05ac6cadf2a5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:24:38.623319 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d0ec6f2-e735-4b55-8f5c-05ac6cadf2a5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:38.623917 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d0ec6f2-e735-4b55-8f5c-05ac6cadf2a5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:38.624731 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9d0ec6f2-e735-4b55-8f5c-05ac6cadf2a5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:38.647516 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9d0ec6f2-e735-4b55-8f5c-05ac6cadf2a5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Going to try to start instance {{(pid=117920) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 02:24:38.691159 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9d0ec6f2-e735-4b55-8f5c-05ac6cadf2a5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "POST /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/action" status: 202 len: 0 microversion: 2.1 time: 0.079505 Aug 05 02:24:38.691718 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 311/618] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Aug 5 02:24:38 2022] POST /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:24:38.703705 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-23936112-7a59-4cc8-a97d-0d8eb2071e83 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:38.704313 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-23936112-7a59-4cc8-a97d-0d8eb2071e83 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:38.710988 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23936112-7a59-4cc8-a97d-0d8eb2071e83 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:38.711498 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23936112-7a59-4cc8-a97d-0d8eb2071e83 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:38.711936 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23936112-7a59-4cc8-a97d-0d8eb2071e83 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:38.713254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23936112-7a59-4cc8-a97d-0d8eb2071e83 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:38.713690 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23936112-7a59-4cc8-a97d-0d8eb2071e83 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:38.714314 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-23936112-7a59-4cc8-a97d-0d8eb2071e83 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:38.733957 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fb5841c2-9d00-4e1a-b2ba-7659f54811bc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:38.734868 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fb5841c2-9d00-4e1a-b2ba-7659f54811bc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:38.740976 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb5841c2-9d00-4e1a-b2ba-7659f54811bc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:38.741451 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb5841c2-9d00-4e1a-b2ba-7659f54811bc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:38.741878 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb5841c2-9d00-4e1a-b2ba-7659f54811bc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:38.742563 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb5841c2-9d00-4e1a-b2ba-7659f54811bc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:38.743016 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb5841c2-9d00-4e1a-b2ba-7659f54811bc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:38.743433 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb5841c2-9d00-4e1a-b2ba-7659f54811bc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:38.878910 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-23936112-7a59-4cc8-a97d-0d8eb2071e83 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:38.886347 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fb5841c2-9d00-4e1a-b2ba-7659f54811bc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:38.888271 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-23936112-7a59-4cc8-a97d-0d8eb2071e83 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1707 microversion: 2.1 time: 0.192177 Aug 05 02:24:38.888946 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 308/619] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:38 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1707 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:38.894255 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7a64c27c-6623-4973-9f99-57cda18feb04 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:38.895137 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7a64c27c-6623-4973-9f99-57cda18feb04 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:38.898166 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fb5841c2-9d00-4e1a-b2ba-7659f54811bc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:38.901046 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fb5841c2-9d00-4e1a-b2ba-7659f54811bc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:38.901681 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7a64c27c-6623-4973-9f99-57cda18feb04 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:38.902398 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7a64c27c-6623-4973-9f99-57cda18feb04 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:38.903024 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7a64c27c-6623-4973-9f99-57cda18feb04 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:38.903173 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fb5841c2-9d00-4e1a-b2ba-7659f54811bc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1743 microversion: 2.20 time: 0.174241 Aug 05 02:24:38.903647 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 312/620] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:38 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:24:38.903803 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7a64c27c-6623-4973-9f99-57cda18feb04 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:38.904409 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7a64c27c-6623-4973-9f99-57cda18feb04 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:38.904876 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7a64c27c-6623-4973-9f99-57cda18feb04 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:39.135901 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7a64c27c-6623-4973-9f99-57cda18feb04 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:39.143131 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7a64c27c-6623-4973-9f99-57cda18feb04 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1368 microversion: 2.1 time: 0.253084 Aug 05 02:24:39.143703 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 309/621] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:38 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:39.909670 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dae453ee-5e03-4217-b395-a274a1bffc91 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:39.910881 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dae453ee-5e03-4217-b395-a274a1bffc91 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:39.917392 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dae453ee-5e03-4217-b395-a274a1bffc91 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:39.917947 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dae453ee-5e03-4217-b395-a274a1bffc91 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:39.918450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dae453ee-5e03-4217-b395-a274a1bffc91 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:39.919209 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dae453ee-5e03-4217-b395-a274a1bffc91 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:39.919729 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dae453ee-5e03-4217-b395-a274a1bffc91 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:39.920217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dae453ee-5e03-4217-b395-a274a1bffc91 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:39.928729 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7ddc319f-d05c-435e-afa5-bb17b40bf623 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:39.929426 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7ddc319f-d05c-435e-afa5-bb17b40bf623 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:39.936356 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ddc319f-d05c-435e-afa5-bb17b40bf623 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:39.939844 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ddc319f-d05c-435e-afa5-bb17b40bf623 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:39.939844 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ddc319f-d05c-435e-afa5-bb17b40bf623 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:39.939844 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ddc319f-d05c-435e-afa5-bb17b40bf623 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:39.939844 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ddc319f-d05c-435e-afa5-bb17b40bf623 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:39.940492 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7ddc319f-d05c-435e-afa5-bb17b40bf623 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:40.075504 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dae453ee-5e03-4217-b395-a274a1bffc91 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:40.085967 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dae453ee-5e03-4217-b395-a274a1bffc91 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1707 microversion: 2.1 time: 0.179988 Aug 05 02:24:40.086864 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 313/622] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:39 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1707 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:40.117942 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7ddc319f-d05c-435e-afa5-bb17b40bf623 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:40.126901 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7ddc319f-d05c-435e-afa5-bb17b40bf623 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:40.128522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7ddc319f-d05c-435e-afa5-bb17b40bf623 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:40.129897 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7ddc319f-d05c-435e-afa5-bb17b40bf623 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1743 microversion: 2.20 time: 0.205019 Aug 05 02:24:40.131196 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 310/623] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:39 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1743 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:24:40.163102 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ffac03fd-f155-42b6-8988-7099eb783139 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:40.163718 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ffac03fd-f155-42b6-8988-7099eb783139 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:40.170551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffac03fd-f155-42b6-8988-7099eb783139 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:40.171044 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffac03fd-f155-42b6-8988-7099eb783139 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:40.171486 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffac03fd-f155-42b6-8988-7099eb783139 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:40.172183 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffac03fd-f155-42b6-8988-7099eb783139 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:40.172674 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffac03fd-f155-42b6-8988-7099eb783139 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:40.173192 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffac03fd-f155-42b6-8988-7099eb783139 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:40.312392 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ffac03fd-f155-42b6-8988-7099eb783139 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:40.319880 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ffac03fd-f155-42b6-8988-7099eb783139 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1368 microversion: 2.1 time: 0.160786 Aug 05 02:24:40.320462 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 314/624] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:40 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:41.108584 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d8e7e238-de60-4a42-ad8a-d83d47c455e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:41.109194 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d8e7e238-de60-4a42-ad8a-d83d47c455e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:41.111010 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:41.111668 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:41.118025 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8e7e238-de60-4a42-ad8a-d83d47c455e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:41.118499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8e7e238-de60-4a42-ad8a-d83d47c455e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:41.118932 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8e7e238-de60-4a42-ad8a-d83d47c455e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:41.120369 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8e7e238-de60-4a42-ad8a-d83d47c455e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:41.120995 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8e7e238-de60-4a42-ad8a-d83d47c455e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:41.121419 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8e7e238-de60-4a42-ad8a-d83d47c455e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:41.154480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-37304389-bca9-4a97-b658-179fcdd48192 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:41.155080 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-37304389-bca9-4a97-b658-179fcdd48192 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:41.157243 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:41.163585 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37304389-bca9-4a97-b658-179fcdd48192 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:41.164106 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37304389-bca9-4a97-b658-179fcdd48192 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:41.164570 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37304389-bca9-4a97-b658-179fcdd48192 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:41.165275 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37304389-bca9-4a97-b658-179fcdd48192 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:41.165760 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37304389-bca9-4a97-b658-179fcdd48192 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:41.166918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37304389-bca9-4a97-b658-179fcdd48192 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:41.274812 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d8e7e238-de60-4a42-ad8a-d83d47c455e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:41.285042 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d8e7e238-de60-4a42-ad8a-d83d47c455e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1711 microversion: 2.1 time: 0.180909 Aug 05 02:24:41.285728 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 311/625] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:41 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1711 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:41.339623 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-37304389-bca9-4a97-b658-179fcdd48192 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:41.342120 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-68b7e8e5-635f-44fd-82bd-07ec61821eb2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:41.342858 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-68b7e8e5-635f-44fd-82bd-07ec61821eb2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:41.348453 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-37304389-bca9-4a97-b658-179fcdd48192 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:41.349519 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-68b7e8e5-635f-44fd-82bd-07ec61821eb2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:41.349995 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-68b7e8e5-635f-44fd-82bd-07ec61821eb2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:41.350106 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-37304389-bca9-4a97-b658-179fcdd48192 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:41.350419 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-68b7e8e5-635f-44fd-82bd-07ec61821eb2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:41.351158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-68b7e8e5-635f-44fd-82bd-07ec61821eb2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:41.351280 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-37304389-bca9-4a97-b658-179fcdd48192 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1743 microversion: 2.20 time: 0.200790 Aug 05 02:24:41.351604 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-68b7e8e5-635f-44fd-82bd-07ec61821eb2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:41.352143 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 315/626] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:41 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1743 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:24:41.352465 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-68b7e8e5-635f-44fd-82bd-07ec61821eb2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:41.491663 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-68b7e8e5-635f-44fd-82bd-07ec61821eb2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:41.499840 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-68b7e8e5-635f-44fd-82bd-07ec61821eb2 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1368 microversion: 2.1 time: 0.163131 Aug 05 02:24:41.501081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 312/627] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:41 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:24:42.374474 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8739034f-ffcb-4f2f-aad1-88331012180c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:42.375081 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8739034f-ffcb-4f2f-aad1-88331012180c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:42.391996 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8739034f-ffcb-4f2f-aad1-88331012180c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:42.392681 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8739034f-ffcb-4f2f-aad1-88331012180c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:42.393263 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8739034f-ffcb-4f2f-aad1-88331012180c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:42.394109 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8739034f-ffcb-4f2f-aad1-88331012180c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:42.394566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8739034f-ffcb-4f2f-aad1-88331012180c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:42.394990 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8739034f-ffcb-4f2f-aad1-88331012180c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:42.520044 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1e7a47b0-6be8-4855-91f7-379c805d3955 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:42.520673 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1e7a47b0-6be8-4855-91f7-379c805d3955 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:42.527015 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e7a47b0-6be8-4855-91f7-379c805d3955 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:42.527492 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e7a47b0-6be8-4855-91f7-379c805d3955 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:42.527917 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e7a47b0-6be8-4855-91f7-379c805d3955 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:42.528621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e7a47b0-6be8-4855-91f7-379c805d3955 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:42.528727 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8739034f-ffcb-4f2f-aad1-88331012180c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:42.529068 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e7a47b0-6be8-4855-91f7-379c805d3955 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:42.529483 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e7a47b0-6be8-4855-91f7-379c805d3955 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:42.536660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8739034f-ffcb-4f2f-aad1-88331012180c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:42.538163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8739034f-ffcb-4f2f-aad1-88331012180c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:42.539311 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8739034f-ffcb-4f2f-aad1-88331012180c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1743 microversion: 2.20 time: 0.168682 Aug 05 02:24:42.539867 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 316/628] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:42 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:42.657844 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1e7a47b0-6be8-4855-91f7-379c805d3955 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:42.665133 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1e7a47b0-6be8-4855-91f7-379c805d3955 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1368 microversion: 2.1 time: 0.148930 Aug 05 02:24:42.665686 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 313/629] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:42 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:43.151269 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-5a6364b4-a51f-4fe3-9653-1bbc962a809d req-284cc1a9-4419-4f96-8afa-7521f833c613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184f7bdb-49dd-4b9c-864d-e07bdb888d6c", "name": "network-vif-plugged", "status": "completed", "tag": "9106f29f-cfec-4c3a-9817-3041bd272f04"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:24:43.160930 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5a6364b4-a51f-4fe3-9653-1bbc962a809d req-284cc1a9-4419-4f96-8afa-7521f833c613 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:43.161923 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5a6364b4-a51f-4fe3-9653-1bbc962a809d req-284cc1a9-4419-4f96-8afa-7521f833c613 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:43.162360 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5a6364b4-a51f-4fe3-9653-1bbc962a809d req-284cc1a9-4419-4f96-8afa-7521f833c613 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:43.174560 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-5a6364b4-a51f-4fe3-9653-1bbc962a809d req-284cc1a9-4419-4f96-8afa-7521f833c613 service nova] Creating event network-vif-plugged:9106f29f-cfec-4c3a-9817-3041bd272f04 for instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c on hv-cinder-81558 Aug 05 02:24:43.179551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-5a6364b4-a51f-4fe3-9653-1bbc962a809d req-284cc1a9-4419-4f96-8afa-7521f833c613 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032928 Aug 05 02:24:43.180398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 317/630] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:24:43.562438 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0b1dc066-800b-4acb-82f0-5206465c9a60 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:43.563023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0b1dc066-800b-4acb-82f0-5206465c9a60 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:43.569145 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b1dc066-800b-4acb-82f0-5206465c9a60 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:43.569622 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b1dc066-800b-4acb-82f0-5206465c9a60 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:43.570056 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b1dc066-800b-4acb-82f0-5206465c9a60 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:43.570799 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b1dc066-800b-4acb-82f0-5206465c9a60 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:43.571253 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b1dc066-800b-4acb-82f0-5206465c9a60 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:43.571671 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b1dc066-800b-4acb-82f0-5206465c9a60 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:43.685916 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-adef1130-3fe8-4708-b608-3cf2dbce22ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:43.686728 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-adef1130-3fe8-4708-b608-3cf2dbce22ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:43.693532 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adef1130-3fe8-4708-b608-3cf2dbce22ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:43.694121 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adef1130-3fe8-4708-b608-3cf2dbce22ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:43.694629 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adef1130-3fe8-4708-b608-3cf2dbce22ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:43.695397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adef1130-3fe8-4708-b608-3cf2dbce22ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:43.695925 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adef1130-3fe8-4708-b608-3cf2dbce22ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:43.696451 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-adef1130-3fe8-4708-b608-3cf2dbce22ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:43.703388 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0b1dc066-800b-4acb-82f0-5206465c9a60 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:43.711222 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0b1dc066-800b-4acb-82f0-5206465c9a60 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:43.712725 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0b1dc066-800b-4acb-82f0-5206465c9a60 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:43.714710 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0b1dc066-800b-4acb-82f0-5206465c9a60 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1743 microversion: 2.20 time: 0.156262 Aug 05 02:24:43.715258 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 314/631] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:43 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:43.828592 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-adef1130-3fe8-4708-b608-3cf2dbce22ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:43.836158 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-adef1130-3fe8-4708-b608-3cf2dbce22ad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1368 microversion: 2.1 time: 0.154409 Aug 05 02:24:43.836765 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 318/632] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:43 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:24:44.738572 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-17a0dbb8-5927-42d4-a96f-0c9884f22046 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:44.739254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-17a0dbb8-5927-42d4-a96f-0c9884f22046 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:44.746989 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17a0dbb8-5927-42d4-a96f-0c9884f22046 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:44.747521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17a0dbb8-5927-42d4-a96f-0c9884f22046 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:44.747949 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17a0dbb8-5927-42d4-a96f-0c9884f22046 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:44.748653 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17a0dbb8-5927-42d4-a96f-0c9884f22046 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:44.749095 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17a0dbb8-5927-42d4-a96f-0c9884f22046 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:44.749506 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17a0dbb8-5927-42d4-a96f-0c9884f22046 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:44.859057 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-54bec9b4-68a4-4f72-982a-c96f26ed9933 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:44.859783 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-54bec9b4-68a4-4f72-982a-c96f26ed9933 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:44.866359 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54bec9b4-68a4-4f72-982a-c96f26ed9933 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:44.866854 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54bec9b4-68a4-4f72-982a-c96f26ed9933 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:44.867360 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54bec9b4-68a4-4f72-982a-c96f26ed9933 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:44.868236 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54bec9b4-68a4-4f72-982a-c96f26ed9933 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:44.868724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54bec9b4-68a4-4f72-982a-c96f26ed9933 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:44.869723 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54bec9b4-68a4-4f72-982a-c96f26ed9933 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:44.887682 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-17a0dbb8-5927-42d4-a96f-0c9884f22046 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:44.895941 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-17a0dbb8-5927-42d4-a96f-0c9884f22046 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:44.897601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-17a0dbb8-5927-42d4-a96f-0c9884f22046 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:44.898899 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-17a0dbb8-5927-42d4-a96f-0c9884f22046 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1743 microversion: 2.20 time: 0.164119 Aug 05 02:24:44.899879 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 315/633] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:44 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:24:45.008857 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-54bec9b4-68a4-4f72-982a-c96f26ed9933 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:45.016222 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-54bec9b4-68a4-4f72-982a-c96f26ed9933 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1368 microversion: 2.1 time: 0.161744 Aug 05 02:24:45.016815 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 319/634] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:44 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:24:45.922402 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1e030aad-1570-4932-b144-661e9bb75c2d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:45.923002 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1e030aad-1570-4932-b144-661e9bb75c2d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:45.929433 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e030aad-1570-4932-b144-661e9bb75c2d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:45.929922 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e030aad-1570-4932-b144-661e9bb75c2d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:45.930339 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e030aad-1570-4932-b144-661e9bb75c2d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:45.931016 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e030aad-1570-4932-b144-661e9bb75c2d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:45.931973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e030aad-1570-4932-b144-661e9bb75c2d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:45.932390 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e030aad-1570-4932-b144-661e9bb75c2d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:46.038044 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a929e055-51a3-4855-9431-6a694f753b2a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:46.039395 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a929e055-51a3-4855-9431-6a694f753b2a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:46.046975 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a929e055-51a3-4855-9431-6a694f753b2a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:46.047488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a929e055-51a3-4855-9431-6a694f753b2a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:46.048147 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a929e055-51a3-4855-9431-6a694f753b2a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:46.049116 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a929e055-51a3-4855-9431-6a694f753b2a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:46.050423 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a929e055-51a3-4855-9431-6a694f753b2a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:46.050858 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a929e055-51a3-4855-9431-6a694f753b2a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:46.077184 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1e030aad-1570-4932-b144-661e9bb75c2d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:46.086148 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1e030aad-1570-4932-b144-661e9bb75c2d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:46.088418 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1e030aad-1570-4932-b144-661e9bb75c2d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:46.090025 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1e030aad-1570-4932-b144-661e9bb75c2d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1738 microversion: 2.20 time: 0.171535 Aug 05 02:24:46.091013 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 316/635] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:45 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:46.199296 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a929e055-51a3-4855-9431-6a694f753b2a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:46.207693 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a929e055-51a3-4855-9431-6a694f753b2a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1558 microversion: 2.1 time: 0.174736 Aug 05 02:24:46.208266 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 320/636] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:24:46 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:24:46.231271 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5ce0530a-30dc-433f-99d5-c43e7747bbfb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:46.231834 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5ce0530a-30dc-433f-99d5-c43e7747bbfb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:46.239018 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ce0530a-30dc-433f-99d5-c43e7747bbfb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:46.239824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ce0530a-30dc-433f-99d5-c43e7747bbfb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:46.240470 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ce0530a-30dc-433f-99d5-c43e7747bbfb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:46.241477 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ce0530a-30dc-433f-99d5-c43e7747bbfb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:46.242076 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ce0530a-30dc-433f-99d5-c43e7747bbfb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:46.243146 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ce0530a-30dc-433f-99d5-c43e7747bbfb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:46.360247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5ce0530a-30dc-433f-99d5-c43e7747bbfb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135137 Aug 05 02:24:46.361540 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 317/637] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Aug 5 02:24:46 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:24:47.114435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bd564d11-229e-4365-a184-edd3fdcfc172 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:47.115663 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bd564d11-229e-4365-a184-edd3fdcfc172 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:47.146228 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd564d11-229e-4365-a184-edd3fdcfc172 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:47.147050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd564d11-229e-4365-a184-edd3fdcfc172 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:47.147496 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd564d11-229e-4365-a184-edd3fdcfc172 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:47.148248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd564d11-229e-4365-a184-edd3fdcfc172 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:47.148742 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd564d11-229e-4365-a184-edd3fdcfc172 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:47.149171 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd564d11-229e-4365-a184-edd3fdcfc172 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:47.574272 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd564d11-229e-4365-a184-edd3fdcfc172 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:47.586006 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd564d11-229e-4365-a184-edd3fdcfc172 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:47.588131 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd564d11-229e-4365-a184-edd3fdcfc172 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:47.589777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bd564d11-229e-4365-a184-edd3fdcfc172 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1738 microversion: 2.20 time: 0.479393 Aug 05 02:24:47.590489 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 321/638] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:47 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1738 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:47.881630 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-e2895caf-ebd3-4864-90fb-e298742f0320 req-2d6a4543-015f-4cf1-88e9-fb37574cbd83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "184f7bdb-49dd-4b9c-864d-e07bdb888d6c", "tag": "9106f29f-cfec-4c3a-9817-3041bd272f04"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:24:47.891880 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-e2895caf-ebd3-4864-90fb-e298742f0320 req-2d6a4543-015f-4cf1-88e9-fb37574cbd83 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:47.892381 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-e2895caf-ebd3-4864-90fb-e298742f0320 req-2d6a4543-015f-4cf1-88e9-fb37574cbd83 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:47.892807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-e2895caf-ebd3-4864-90fb-e298742f0320 req-2d6a4543-015f-4cf1-88e9-fb37574cbd83 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:47.905369 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-e2895caf-ebd3-4864-90fb-e298742f0320 req-2d6a4543-015f-4cf1-88e9-fb37574cbd83 service nova] Creating event network-changed:9106f29f-cfec-4c3a-9817-3041bd272f04 for instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c on hv-cinder-81558 Aug 05 02:24:47.911102 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-e2895caf-ebd3-4864-90fb-e298742f0320 req-2d6a4543-015f-4cf1-88e9-fb37574cbd83 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033759 Aug 05 02:24:47.912265 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 318/639] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:24:48.661886 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9b113f44-534c-47df-9930-b12891f41a6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:48.663986 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9b113f44-534c-47df-9930-b12891f41a6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:48.677941 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b113f44-534c-47df-9930-b12891f41a6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:48.679084 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b113f44-534c-47df-9930-b12891f41a6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:48.679952 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b113f44-534c-47df-9930-b12891f41a6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:48.681258 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b113f44-534c-47df-9930-b12891f41a6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:48.682992 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b113f44-534c-47df-9930-b12891f41a6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:48.683720 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b113f44-534c-47df-9930-b12891f41a6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:48.873038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9b113f44-534c-47df-9930-b12891f41a6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:48.876689 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:48.883206 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9b113f44-534c-47df-9930-b12891f41a6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:48.884880 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9b113f44-534c-47df-9930-b12891f41a6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:48.886200 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9b113f44-534c-47df-9930-b12891f41a6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1738 microversion: 2.20 time: 0.271665 Aug 05 02:24:48.887118 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 322/640] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:48 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:49.913637 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-18a5f091-f100-4a26-a46a-5bab302b1130 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:49.914329 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-18a5f091-f100-4a26-a46a-5bab302b1130 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:49.921498 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-18a5f091-f100-4a26-a46a-5bab302b1130 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:49.921980 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-18a5f091-f100-4a26-a46a-5bab302b1130 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:49.922405 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-18a5f091-f100-4a26-a46a-5bab302b1130 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:49.923087 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-18a5f091-f100-4a26-a46a-5bab302b1130 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:49.923530 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-18a5f091-f100-4a26-a46a-5bab302b1130 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:49.923949 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-18a5f091-f100-4a26-a46a-5bab302b1130 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:49.928488 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:50.081109 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-18a5f091-f100-4a26-a46a-5bab302b1130 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:50.089760 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-18a5f091-f100-4a26-a46a-5bab302b1130 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:50.095921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-18a5f091-f100-4a26-a46a-5bab302b1130 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:50.097147 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-18a5f091-f100-4a26-a46a-5bab302b1130 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1738 microversion: 2.20 time: 0.187840 Aug 05 02:24:50.098293 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 319/641] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:49 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:51.121572 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-77aace02-0b1c-46d5-be57-bb7f0b56bda5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:51.123213 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-77aace02-0b1c-46d5-be57-bb7f0b56bda5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:51.129971 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77aace02-0b1c-46d5-be57-bb7f0b56bda5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:51.130729 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77aace02-0b1c-46d5-be57-bb7f0b56bda5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:51.131389 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77aace02-0b1c-46d5-be57-bb7f0b56bda5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:51.132094 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77aace02-0b1c-46d5-be57-bb7f0b56bda5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:51.132620 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77aace02-0b1c-46d5-be57-bb7f0b56bda5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:51.133052 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77aace02-0b1c-46d5-be57-bb7f0b56bda5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:51.293206 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-77aace02-0b1c-46d5-be57-bb7f0b56bda5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:51.301506 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-77aace02-0b1c-46d5-be57-bb7f0b56bda5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:51.305024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-77aace02-0b1c-46d5-be57-bb7f0b56bda5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:51.306833 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-77aace02-0b1c-46d5-be57-bb7f0b56bda5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1738 microversion: 2.20 time: 0.189597 Aug 05 02:24:51.320060 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 323/642] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:51 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:52.342056 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c196701b-c7bd-4009-8edb-e3aa6dddb88f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:52.343417 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c196701b-c7bd-4009-8edb-e3aa6dddb88f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:52.353231 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c196701b-c7bd-4009-8edb-e3aa6dddb88f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:52.354103 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c196701b-c7bd-4009-8edb-e3aa6dddb88f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:52.354756 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c196701b-c7bd-4009-8edb-e3aa6dddb88f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:52.355699 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c196701b-c7bd-4009-8edb-e3aa6dddb88f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:52.356369 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c196701b-c7bd-4009-8edb-e3aa6dddb88f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:52.357010 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c196701b-c7bd-4009-8edb-e3aa6dddb88f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:52.544466 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c196701b-c7bd-4009-8edb-e3aa6dddb88f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:52.552966 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c196701b-c7bd-4009-8edb-e3aa6dddb88f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:52.554651 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c196701b-c7bd-4009-8edb-e3aa6dddb88f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:52.555820 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c196701b-c7bd-4009-8edb-e3aa6dddb88f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1738 microversion: 2.20 time: 0.226214 Aug 05 02:24:52.558477 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 320/643] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:52 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:53.581026 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f82c2085-1db6-4b52-af26-e04ad36dba8b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:53.581733 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f82c2085-1db6-4b52-af26-e04ad36dba8b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:53.588424 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f82c2085-1db6-4b52-af26-e04ad36dba8b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:53.588907 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f82c2085-1db6-4b52-af26-e04ad36dba8b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:53.589360 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f82c2085-1db6-4b52-af26-e04ad36dba8b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:53.590038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f82c2085-1db6-4b52-af26-e04ad36dba8b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:53.590509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f82c2085-1db6-4b52-af26-e04ad36dba8b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:53.590930 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f82c2085-1db6-4b52-af26-e04ad36dba8b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:53.731571 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f82c2085-1db6-4b52-af26-e04ad36dba8b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:53.739768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f82c2085-1db6-4b52-af26-e04ad36dba8b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:53.741984 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f82c2085-1db6-4b52-af26-e04ad36dba8b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:53.743294 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f82c2085-1db6-4b52-af26-e04ad36dba8b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1738 microversion: 2.20 time: 0.166134 Aug 05 02:24:53.744753 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 324/644] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:53 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:54.766570 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b72f7a93-c621-4d01-82e8-67a29a00ec3f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:54.767191 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b72f7a93-c621-4d01-82e8-67a29a00ec3f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:54.774148 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b72f7a93-c621-4d01-82e8-67a29a00ec3f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:54.774646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b72f7a93-c621-4d01-82e8-67a29a00ec3f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:54.775793 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b72f7a93-c621-4d01-82e8-67a29a00ec3f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:54.776551 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b72f7a93-c621-4d01-82e8-67a29a00ec3f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:54.777010 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b72f7a93-c621-4d01-82e8-67a29a00ec3f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:54.777436 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b72f7a93-c621-4d01-82e8-67a29a00ec3f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:54.951687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b72f7a93-c621-4d01-82e8-67a29a00ec3f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:54.971417 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b72f7a93-c621-4d01-82e8-67a29a00ec3f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:54.976000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b72f7a93-c621-4d01-82e8-67a29a00ec3f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:54.977338 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b72f7a93-c621-4d01-82e8-67a29a00ec3f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1738 microversion: 2.20 time: 0.214866 Aug 05 02:24:54.978007 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 321/645] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:54 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:56.002599 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6864281f-758d-447f-904b-4ad799fd14bf tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:56.003199 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6864281f-758d-447f-904b-4ad799fd14bf tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:56.009537 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6864281f-758d-447f-904b-4ad799fd14bf tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:56.010014 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6864281f-758d-447f-904b-4ad799fd14bf tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:56.010436 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6864281f-758d-447f-904b-4ad799fd14bf tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:56.011112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6864281f-758d-447f-904b-4ad799fd14bf tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:56.011555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6864281f-758d-447f-904b-4ad799fd14bf tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:56.011971 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6864281f-758d-447f-904b-4ad799fd14bf tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:56.142899 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6864281f-758d-447f-904b-4ad799fd14bf tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:56.151140 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6864281f-758d-447f-904b-4ad799fd14bf tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:56.152656 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6864281f-758d-447f-904b-4ad799fd14bf tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:56.153802 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6864281f-758d-447f-904b-4ad799fd14bf tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1738 microversion: 2.20 time: 0.155150 Aug 05 02:24:56.154343 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 325/646] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:55 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:24:57.176796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-50e6802a-3c08-4e7a-9274-c1d85177cdae tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:57.177414 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-50e6802a-3c08-4e7a-9274-c1d85177cdae tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:57.184352 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50e6802a-3c08-4e7a-9274-c1d85177cdae tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:57.184850 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50e6802a-3c08-4e7a-9274-c1d85177cdae tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:57.185282 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50e6802a-3c08-4e7a-9274-c1d85177cdae tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:57.185978 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50e6802a-3c08-4e7a-9274-c1d85177cdae tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:57.186428 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50e6802a-3c08-4e7a-9274-c1d85177cdae tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:57.186850 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50e6802a-3c08-4e7a-9274-c1d85177cdae tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:57.319473 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-50e6802a-3c08-4e7a-9274-c1d85177cdae tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:57.327196 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-50e6802a-3c08-4e7a-9274-c1d85177cdae tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:57.328702 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-50e6802a-3c08-4e7a-9274-c1d85177cdae tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:57.329955 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-50e6802a-3c08-4e7a-9274-c1d85177cdae tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1720 microversion: 2.20 time: 0.157846 Aug 05 02:24:57.330509 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 322/647] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:57 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:58.353022 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-94d2e4b9-418f-4380-a9f9-64c61d54aea4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:58.353651 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-94d2e4b9-418f-4380-a9f9-64c61d54aea4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:58.359944 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94d2e4b9-418f-4380-a9f9-64c61d54aea4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:58.360457 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94d2e4b9-418f-4380-a9f9-64c61d54aea4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:58.360887 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94d2e4b9-418f-4380-a9f9-64c61d54aea4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:58.361563 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94d2e4b9-418f-4380-a9f9-64c61d54aea4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:58.362007 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94d2e4b9-418f-4380-a9f9-64c61d54aea4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:58.362429 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94d2e4b9-418f-4380-a9f9-64c61d54aea4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:58.487987 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-94d2e4b9-418f-4380-a9f9-64c61d54aea4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:58.496549 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-94d2e4b9-418f-4380-a9f9-64c61d54aea4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:58.498052 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-94d2e4b9-418f-4380-a9f9-64c61d54aea4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:58.499201 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-94d2e4b9-418f-4380-a9f9-64c61d54aea4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1720 microversion: 2.20 time: 0.150053 Aug 05 02:24:58.499753 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 326/648] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:58 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:24:59.523055 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e1d4330f-4b68-4a51-93da-413ba8659ef1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:24:59.523634 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e1d4330f-4b68-4a51-93da-413ba8659ef1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:59.530770 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e1d4330f-4b68-4a51-93da-413ba8659ef1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:59.531275 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e1d4330f-4b68-4a51-93da-413ba8659ef1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:59.531958 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e1d4330f-4b68-4a51-93da-413ba8659ef1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:59.532688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e1d4330f-4b68-4a51-93da-413ba8659ef1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:59.533139 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e1d4330f-4b68-4a51-93da-413ba8659ef1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:59.533561 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e1d4330f-4b68-4a51-93da-413ba8659ef1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:59.676503 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e1d4330f-4b68-4a51-93da-413ba8659ef1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:59.684342 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e1d4330f-4b68-4a51-93da-413ba8659ef1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:59.685839 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e1d4330f-4b68-4a51-93da-413ba8659ef1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:24:59.686991 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e1d4330f-4b68-4a51-93da-413ba8659ef1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1723 microversion: 2.20 time: 0.167989 Aug 05 02:24:59.687552 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 323/649] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:24:59 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:24:59.709822 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-418b6afe-d1eb-4171-80f4-8d1e64e9e402 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2751bbfe-0517-4041-83bf-17de153f0afa"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:24:59.712538 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-418b6afe-d1eb-4171-80f4-8d1e64e9e402 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:24:59.720196 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-418b6afe-d1eb-4171-80f4-8d1e64e9e402 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:59.720849 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-418b6afe-d1eb-4171-80f4-8d1e64e9e402 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:59.721282 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-418b6afe-d1eb-4171-80f4-8d1e64e9e402 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:24:59.721986 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-418b6afe-d1eb-4171-80f4-8d1e64e9e402 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:24:59.722439 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-418b6afe-d1eb-4171-80f4-8d1e64e9e402 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:24:59.722863 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-418b6afe-d1eb-4171-80f4-8d1e64e9e402 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:00.065287 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-418b6afe-d1eb-4171-80f4-8d1e64e9e402 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "POST /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.359463 Aug 05 02:25:00.065884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 327/650] 10.222.0.15 () {62 vars in 1364 bytes} [Fri Aug 5 02:24:59 2022] POST /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/os-volume_attachments => generated 188 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:25:00.186797 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2307101b-5e9c-4a78-809c-210c86331430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:25:00.187381 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2307101b-5e9c-4a78-809c-210c86331430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:00.193138 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2307101b-5e9c-4a78-809c-210c86331430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:00.193616 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2307101b-5e9c-4a78-809c-210c86331430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:00.194039 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2307101b-5e9c-4a78-809c-210c86331430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:00.194713 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2307101b-5e9c-4a78-809c-210c86331430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:00.195157 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2307101b-5e9c-4a78-809c-210c86331430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:00.195569 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2307101b-5e9c-4a78-809c-210c86331430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:00.237689 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2307101b-5e9c-4a78-809c-210c86331430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117921) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 02:25:00.302290 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2307101b-5e9c-4a78-809c-210c86331430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "POST /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/action" status: 202 len: 0 microversion: 2.20 time: 0.119177 Aug 05 02:25:00.302826 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 324/651] 10.222.0.15 () {62 vars in 1319 bytes} [Fri Aug 5 02:25:00 2022] POST /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:25:00.311069 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eeca3149-a022-4651-81e3-82cd44599b03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:00.311672 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eeca3149-a022-4651-81e3-82cd44599b03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:00.318260 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eeca3149-a022-4651-81e3-82cd44599b03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:00.318740 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eeca3149-a022-4651-81e3-82cd44599b03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:00.319172 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eeca3149-a022-4651-81e3-82cd44599b03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:00.319856 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eeca3149-a022-4651-81e3-82cd44599b03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:00.320302 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eeca3149-a022-4651-81e3-82cd44599b03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:00.320750 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eeca3149-a022-4651-81e3-82cd44599b03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:00.451428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eeca3149-a022-4651-81e3-82cd44599b03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:00.460518 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eeca3149-a022-4651-81e3-82cd44599b03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:00.462712 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eeca3149-a022-4651-81e3-82cd44599b03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:00.463865 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eeca3149-a022-4651-81e3-82cd44599b03 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1749 microversion: 2.20 time: 0.156760 Aug 05 02:25:00.464422 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 328/652] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:00 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:25:01.188588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-98be1df8-88eb-4dbc-9efc-42ecf9b0894f req-622e577f-4fa4-4ccd-ba27-406490a3d7cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319a8a64-7b50-4fff-93b6-4498b53265ab", "name": "network-vif-unplugged", "status": "completed", "tag": "661635b8-8836-4704-91ee-343c5d3a40eb"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:25:01.199235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-98be1df8-88eb-4dbc-9efc-42ecf9b0894f req-622e577f-4fa4-4ccd-ba27-406490a3d7cf service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:01.199820 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-98be1df8-88eb-4dbc-9efc-42ecf9b0894f req-622e577f-4fa4-4ccd-ba27-406490a3d7cf service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:01.200377 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-98be1df8-88eb-4dbc-9efc-42ecf9b0894f req-622e577f-4fa4-4ccd-ba27-406490a3d7cf service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:01.213316 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.compute.server_external_events [req-98be1df8-88eb-4dbc-9efc-42ecf9b0894f req-622e577f-4fa4-4ccd-ba27-406490a3d7cf service nova] Unable to find a host for instance 319a8a64-7b50-4fff-93b6-4498b53265ab. Dropping event network-vif-unplugged {{(pid=117921) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 05 02:25:01.214204 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-98be1df8-88eb-4dbc-9efc-42ecf9b0894f req-622e577f-4fa4-4ccd-ba27-406490a3d7cf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030579 Aug 05 02:25:01.214793 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 325/653] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 05 02:25:01.486391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2b0a79f7-16d4-4e88-ba7f-7fff65cbe6bd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:01.487002 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2b0a79f7-16d4-4e88-ba7f-7fff65cbe6bd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:01.495099 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b0a79f7-16d4-4e88-ba7f-7fff65cbe6bd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:01.495582 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b0a79f7-16d4-4e88-ba7f-7fff65cbe6bd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:01.496016 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b0a79f7-16d4-4e88-ba7f-7fff65cbe6bd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:01.496758 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b0a79f7-16d4-4e88-ba7f-7fff65cbe6bd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:01.497209 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b0a79f7-16d4-4e88-ba7f-7fff65cbe6bd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:01.497632 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b0a79f7-16d4-4e88-ba7f-7fff65cbe6bd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:01.632619 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2b0a79f7-16d4-4e88-ba7f-7fff65cbe6bd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:01.641732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2b0a79f7-16d4-4e88-ba7f-7fff65cbe6bd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:01.643238 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2b0a79f7-16d4-4e88-ba7f-7fff65cbe6bd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:01.644461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2b0a79f7-16d4-4e88-ba7f-7fff65cbe6bd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1751 microversion: 2.20 time: 0.161986 Aug 05 02:25:01.645020 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 329/654] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:01 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:02.669483 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d1307840-5cd2-41e4-ad6e-52d666a76cd5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:02.669991 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d1307840-5cd2-41e4-ad6e-52d666a76cd5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:02.676552 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1307840-5cd2-41e4-ad6e-52d666a76cd5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:02.677030 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1307840-5cd2-41e4-ad6e-52d666a76cd5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:02.677468 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1307840-5cd2-41e4-ad6e-52d666a76cd5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:02.678148 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1307840-5cd2-41e4-ad6e-52d666a76cd5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:02.678599 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1307840-5cd2-41e4-ad6e-52d666a76cd5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:02.679018 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1307840-5cd2-41e4-ad6e-52d666a76cd5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:02.806998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d1307840-5cd2-41e4-ad6e-52d666a76cd5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:02.815370 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d1307840-5cd2-41e4-ad6e-52d666a76cd5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:02.816906 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d1307840-5cd2-41e4-ad6e-52d666a76cd5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:02.818056 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d1307840-5cd2-41e4-ad6e-52d666a76cd5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.153137 Aug 05 02:25:02.818614 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 326/655] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:02 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:03.842260 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5b1134fc-ae7e-47cc-9664-fd569f6c9dc8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:03.843808 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5b1134fc-ae7e-47cc-9664-fd569f6c9dc8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:03.846142 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=53 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:25:03.851721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b1134fc-ae7e-47cc-9664-fd569f6c9dc8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:03.852205 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b1134fc-ae7e-47cc-9664-fd569f6c9dc8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:03.852670 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b1134fc-ae7e-47cc-9664-fd569f6c9dc8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:03.853700 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b1134fc-ae7e-47cc-9664-fd569f6c9dc8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:03.854178 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b1134fc-ae7e-47cc-9664-fd569f6c9dc8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:03.854605 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b1134fc-ae7e-47cc-9664-fd569f6c9dc8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:03.988510 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5b1134fc-ae7e-47cc-9664-fd569f6c9dc8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:03.998172 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5b1134fc-ae7e-47cc-9664-fd569f6c9dc8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:04.000921 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5b1134fc-ae7e-47cc-9664-fd569f6c9dc8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:04.002914 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5b1134fc-ae7e-47cc-9664-fd569f6c9dc8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.164603 Aug 05 02:25:04.016939 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 330/656] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:03 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:05.037005 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e63e5f1a-cb53-4cd6-8f5b-4abd0ad9ddb5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:05.037600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e63e5f1a-cb53-4cd6-8f5b-4abd0ad9ddb5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:05.044809 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e63e5f1a-cb53-4cd6-8f5b-4abd0ad9ddb5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:05.045283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e63e5f1a-cb53-4cd6-8f5b-4abd0ad9ddb5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:05.045773 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e63e5f1a-cb53-4cd6-8f5b-4abd0ad9ddb5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:05.046543 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e63e5f1a-cb53-4cd6-8f5b-4abd0ad9ddb5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:05.047026 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e63e5f1a-cb53-4cd6-8f5b-4abd0ad9ddb5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:05.047443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e63e5f1a-cb53-4cd6-8f5b-4abd0ad9ddb5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:05.178354 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e63e5f1a-cb53-4cd6-8f5b-4abd0ad9ddb5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:05.186710 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e63e5f1a-cb53-4cd6-8f5b-4abd0ad9ddb5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:05.188185 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e63e5f1a-cb53-4cd6-8f5b-4abd0ad9ddb5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:05.189354 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e63e5f1a-cb53-4cd6-8f5b-4abd0ad9ddb5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.156210 Aug 05 02:25:05.189913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 327/657] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:05 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:06.212804 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7fd46ca8-f68d-4c3d-8f37-b75fab5d10c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:06.214013 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7fd46ca8-f68d-4c3d-8f37-b75fab5d10c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:06.220904 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fd46ca8-f68d-4c3d-8f37-b75fab5d10c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:06.221395 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fd46ca8-f68d-4c3d-8f37-b75fab5d10c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:06.221835 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fd46ca8-f68d-4c3d-8f37-b75fab5d10c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:06.222537 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fd46ca8-f68d-4c3d-8f37-b75fab5d10c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:06.222992 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fd46ca8-f68d-4c3d-8f37-b75fab5d10c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:06.223417 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7fd46ca8-f68d-4c3d-8f37-b75fab5d10c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:06.363314 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7fd46ca8-f68d-4c3d-8f37-b75fab5d10c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:06.372472 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7fd46ca8-f68d-4c3d-8f37-b75fab5d10c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:06.373984 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7fd46ca8-f68d-4c3d-8f37-b75fab5d10c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:06.375244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7fd46ca8-f68d-4c3d-8f37-b75fab5d10c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.166330 Aug 05 02:25:06.375808 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 331/658] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:06 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:07.399126 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3218c0f3-1722-46b6-ade1-40d410d268d2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:07.399730 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3218c0f3-1722-46b6-ade1-40d410d268d2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:07.402572 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:25:07.408925 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3218c0f3-1722-46b6-ade1-40d410d268d2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:07.409411 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3218c0f3-1722-46b6-ade1-40d410d268d2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:07.410052 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3218c0f3-1722-46b6-ade1-40d410d268d2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:07.411042 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3218c0f3-1722-46b6-ade1-40d410d268d2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:07.411498 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3218c0f3-1722-46b6-ade1-40d410d268d2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:07.411921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3218c0f3-1722-46b6-ade1-40d410d268d2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:07.556945 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3218c0f3-1722-46b6-ade1-40d410d268d2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:07.573262 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3218c0f3-1722-46b6-ade1-40d410d268d2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:07.574970 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3218c0f3-1722-46b6-ade1-40d410d268d2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:07.576152 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3218c0f3-1722-46b6-ade1-40d410d268d2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.180993 Aug 05 02:25:07.576725 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 328/659] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:07 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:08.599524 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eecb6dc7-c425-41c7-a9c9-d1bc40653e2b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:08.600129 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eecb6dc7-c425-41c7-a9c9-d1bc40653e2b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:08.607323 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eecb6dc7-c425-41c7-a9c9-d1bc40653e2b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:08.607806 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eecb6dc7-c425-41c7-a9c9-d1bc40653e2b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:08.608244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eecb6dc7-c425-41c7-a9c9-d1bc40653e2b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:08.608960 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eecb6dc7-c425-41c7-a9c9-d1bc40653e2b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:08.609405 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eecb6dc7-c425-41c7-a9c9-d1bc40653e2b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:08.609820 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eecb6dc7-c425-41c7-a9c9-d1bc40653e2b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:08.743288 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eecb6dc7-c425-41c7-a9c9-d1bc40653e2b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:08.752442 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eecb6dc7-c425-41c7-a9c9-d1bc40653e2b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:08.753900 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eecb6dc7-c425-41c7-a9c9-d1bc40653e2b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:08.755077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eecb6dc7-c425-41c7-a9c9-d1bc40653e2b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.159564 Aug 05 02:25:08.755890 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 332/660] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:08 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:09.778689 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7992f268-00f2-481d-b4e5-74eaf3108356 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:09.779308 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7992f268-00f2-481d-b4e5-74eaf3108356 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:09.785423 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7992f268-00f2-481d-b4e5-74eaf3108356 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:09.785908 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7992f268-00f2-481d-b4e5-74eaf3108356 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:09.786340 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7992f268-00f2-481d-b4e5-74eaf3108356 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:09.787035 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7992f268-00f2-481d-b4e5-74eaf3108356 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:09.787482 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7992f268-00f2-481d-b4e5-74eaf3108356 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:09.787968 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7992f268-00f2-481d-b4e5-74eaf3108356 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:09.926515 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7992f268-00f2-481d-b4e5-74eaf3108356 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:09.936264 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7992f268-00f2-481d-b4e5-74eaf3108356 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:09.937777 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7992f268-00f2-481d-b4e5-74eaf3108356 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:09.938935 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7992f268-00f2-481d-b4e5-74eaf3108356 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.164838 Aug 05 02:25:09.939492 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 329/661] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:09 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:10.963309 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-93c3435a-895e-4a47-b39b-81ba9b139f6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:10.964102 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-93c3435a-895e-4a47-b39b-81ba9b139f6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:10.971140 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93c3435a-895e-4a47-b39b-81ba9b139f6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:10.971926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93c3435a-895e-4a47-b39b-81ba9b139f6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:10.972385 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93c3435a-895e-4a47-b39b-81ba9b139f6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:10.973096 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93c3435a-895e-4a47-b39b-81ba9b139f6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:10.973552 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93c3435a-895e-4a47-b39b-81ba9b139f6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:10.973979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93c3435a-895e-4a47-b39b-81ba9b139f6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:11.024631 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b9f0120f-d6bd-4b54-b0bf-6ddc8077c8f3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:25:11.027903 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b9f0120f-d6bd-4b54-b0bf-6ddc8077c8f3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:11.035046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b9f0120f-d6bd-4b54-b0bf-6ddc8077c8f3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:11.035638 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b9f0120f-d6bd-4b54-b0bf-6ddc8077c8f3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:11.036139 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b9f0120f-d6bd-4b54-b0bf-6ddc8077c8f3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:11.037341 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b9f0120f-d6bd-4b54-b0bf-6ddc8077c8f3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:11.038082 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b9f0120f-d6bd-4b54-b0bf-6ddc8077c8f3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:11.038796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b9f0120f-d6bd-4b54-b0bf-6ddc8077c8f3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:11.116360 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-93c3435a-895e-4a47-b39b-81ba9b139f6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:11.117056 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b9f0120f-d6bd-4b54-b0bf-6ddc8077c8f3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "POST /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/action" status: 202 len: 0 microversion: 2.1 time: 0.096296 Aug 05 02:25:11.121165 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 330/662] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Aug 5 02:25:11 2022] POST /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:25:11.126667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-93c3435a-895e-4a47-b39b-81ba9b139f6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:11.127111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-edb69063-d537-4e14-9ebc-044ebdd418ba tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:11.127862 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-edb69063-d537-4e14-9ebc-044ebdd418ba tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:11.128175 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-93c3435a-895e-4a47-b39b-81ba9b139f6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:11.129384 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-93c3435a-895e-4a47-b39b-81ba9b139f6e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.169969 Aug 05 02:25:11.129939 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 333/663] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:10 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:11.134163 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-edb69063-d537-4e14-9ebc-044ebdd418ba tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:11.134636 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-edb69063-d537-4e14-9ebc-044ebdd418ba tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:11.135062 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-edb69063-d537-4e14-9ebc-044ebdd418ba tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:11.135739 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-edb69063-d537-4e14-9ebc-044ebdd418ba tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:11.141044 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-edb69063-d537-4e14-9ebc-044ebdd418ba tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:11.141044 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-edb69063-d537-4e14-9ebc-044ebdd418ba tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:11.293107 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-edb69063-d537-4e14-9ebc-044ebdd418ba tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:11.301477 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-edb69063-d537-4e14-9ebc-044ebdd418ba tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1749 microversion: 2.1 time: 0.178685 Aug 05 02:25:11.308374 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 331/664] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:11 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1749 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:25:12.153712 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-05e91bb5-6937-4540-9c90-84ece174e11d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:12.154588 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-05e91bb5-6937-4540-9c90-84ece174e11d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:12.161068 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05e91bb5-6937-4540-9c90-84ece174e11d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:12.161572 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05e91bb5-6937-4540-9c90-84ece174e11d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:12.162000 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05e91bb5-6937-4540-9c90-84ece174e11d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:12.162689 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05e91bb5-6937-4540-9c90-84ece174e11d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:12.163132 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05e91bb5-6937-4540-9c90-84ece174e11d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:12.163546 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05e91bb5-6937-4540-9c90-84ece174e11d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:12.317171 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-05e91bb5-6937-4540-9c90-84ece174e11d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:12.323418 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6ec1fb9e-6911-47da-8625-6296f2519031 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:12.324846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6ec1fb9e-6911-47da-8625-6296f2519031 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:12.326561 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-05e91bb5-6937-4540-9c90-84ece174e11d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:12.328364 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-05e91bb5-6937-4540-9c90-84ece174e11d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:12.329780 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-05e91bb5-6937-4540-9c90-84ece174e11d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.180127 Aug 05 02:25:12.340590 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ec1fb9e-6911-47da-8625-6296f2519031 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:12.340590 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ec1fb9e-6911-47da-8625-6296f2519031 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:12.340590 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ec1fb9e-6911-47da-8625-6296f2519031 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:12.340590 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ec1fb9e-6911-47da-8625-6296f2519031 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:12.341329 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ec1fb9e-6911-47da-8625-6296f2519031 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:12.341329 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ec1fb9e-6911-47da-8625-6296f2519031 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:12.342102 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 334/665] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:12 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:12.501145 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6ec1fb9e-6911-47da-8625-6296f2519031 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:12.509324 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6ec1fb9e-6911-47da-8625-6296f2519031 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1749 microversion: 2.1 time: 0.189626 Aug 05 02:25:12.509890 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 332/666] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:12 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1749 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:25:13.356124 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3b003d23-8419-48f4-9801-027eed8bab21 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:13.356773 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3b003d23-8419-48f4-9801-027eed8bab21 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:13.363181 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b003d23-8419-48f4-9801-027eed8bab21 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:13.363655 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b003d23-8419-48f4-9801-027eed8bab21 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:13.364089 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b003d23-8419-48f4-9801-027eed8bab21 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:13.364801 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b003d23-8419-48f4-9801-027eed8bab21 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:13.365276 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b003d23-8419-48f4-9801-027eed8bab21 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:13.365694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b003d23-8419-48f4-9801-027eed8bab21 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:13.504809 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3b003d23-8419-48f4-9801-027eed8bab21 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:13.513848 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3b003d23-8419-48f4-9801-027eed8bab21 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:13.515349 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3b003d23-8419-48f4-9801-027eed8bab21 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:13.516580 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3b003d23-8419-48f4-9801-027eed8bab21 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.165312 Aug 05 02:25:13.517173 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 335/667] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:13 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:13.530766 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5f1ac59f-9300-4c86-9b95-d69ac2c90ca2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:13.531402 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5f1ac59f-9300-4c86-9b95-d69ac2c90ca2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:13.537757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f1ac59f-9300-4c86-9b95-d69ac2c90ca2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:13.538232 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f1ac59f-9300-4c86-9b95-d69ac2c90ca2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:13.538665 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f1ac59f-9300-4c86-9b95-d69ac2c90ca2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:13.539344 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f1ac59f-9300-4c86-9b95-d69ac2c90ca2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:13.539791 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f1ac59f-9300-4c86-9b95-d69ac2c90ca2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:13.540208 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f1ac59f-9300-4c86-9b95-d69ac2c90ca2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:13.748516 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5f1ac59f-9300-4c86-9b95-d69ac2c90ca2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:13.756937 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5f1ac59f-9300-4c86-9b95-d69ac2c90ca2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1749 microversion: 2.1 time: 0.229838 Aug 05 02:25:13.757890 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 333/668] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:13 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1749 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:14.540072 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-735ef364-fe9b-4ce0-bd44-28f588f6a573 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:14.540707 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-735ef364-fe9b-4ce0-bd44-28f588f6a573 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:14.547069 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-735ef364-fe9b-4ce0-bd44-28f588f6a573 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:14.547551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-735ef364-fe9b-4ce0-bd44-28f588f6a573 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:14.547987 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-735ef364-fe9b-4ce0-bd44-28f588f6a573 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:14.548713 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-735ef364-fe9b-4ce0-bd44-28f588f6a573 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:14.549167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-735ef364-fe9b-4ce0-bd44-28f588f6a573 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:14.549590 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-735ef364-fe9b-4ce0-bd44-28f588f6a573 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:14.687294 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-735ef364-fe9b-4ce0-bd44-28f588f6a573 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:14.690664 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:25:14.697274 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-735ef364-fe9b-4ce0-bd44-28f588f6a573 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:14.699445 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-735ef364-fe9b-4ce0-bd44-28f588f6a573 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:14.700611 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-735ef364-fe9b-4ce0-bd44-28f588f6a573 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.164524 Aug 05 02:25:14.701165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 336/669] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:14 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:14.778757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f703a8de-b27b-4c60-bbd2-342844512e16 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:14.779387 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f703a8de-b27b-4c60-bbd2-342844512e16 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:14.786098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f703a8de-b27b-4c60-bbd2-342844512e16 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:14.786572 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f703a8de-b27b-4c60-bbd2-342844512e16 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:14.787072 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f703a8de-b27b-4c60-bbd2-342844512e16 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:14.787934 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f703a8de-b27b-4c60-bbd2-342844512e16 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:14.788427 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f703a8de-b27b-4c60-bbd2-342844512e16 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:14.788846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f703a8de-b27b-4c60-bbd2-342844512e16 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:14.808858 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:25:14.961529 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f703a8de-b27b-4c60-bbd2-342844512e16 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:14.980474 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f703a8de-b27b-4c60-bbd2-342844512e16 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1749 microversion: 2.1 time: 0.205337 Aug 05 02:25:14.981366 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 334/670] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:14 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1749 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:15.723197 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9b9e85e3-918f-4fb3-a7b4-40f5431271ea tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:15.723802 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9b9e85e3-918f-4fb3-a7b4-40f5431271ea tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:15.732541 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b9e85e3-918f-4fb3-a7b4-40f5431271ea tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:15.733015 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b9e85e3-918f-4fb3-a7b4-40f5431271ea tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:15.733451 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b9e85e3-918f-4fb3-a7b4-40f5431271ea tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:15.734165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b9e85e3-918f-4fb3-a7b4-40f5431271ea tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:15.734619 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b9e85e3-918f-4fb3-a7b4-40f5431271ea tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:15.735039 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b9e85e3-918f-4fb3-a7b4-40f5431271ea tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:15.930931 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9b9e85e3-918f-4fb3-a7b4-40f5431271ea tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:15.939559 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9b9e85e3-918f-4fb3-a7b4-40f5431271ea tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:15.941080 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9b9e85e3-918f-4fb3-a7b4-40f5431271ea tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:15.942265 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9b9e85e3-918f-4fb3-a7b4-40f5431271ea tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.223113 Aug 05 02:25:15.942812 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 337/671] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:15 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:16.003361 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-074085dd-7097-4f55-880a-51b14267c4f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:16.003925 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-074085dd-7097-4f55-880a-51b14267c4f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:16.010603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-074085dd-7097-4f55-880a-51b14267c4f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:16.011633 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-074085dd-7097-4f55-880a-51b14267c4f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:16.012291 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-074085dd-7097-4f55-880a-51b14267c4f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:16.013238 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-074085dd-7097-4f55-880a-51b14267c4f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:16.013894 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-074085dd-7097-4f55-880a-51b14267c4f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:16.014522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-074085dd-7097-4f55-880a-51b14267c4f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:16.171692 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-074085dd-7097-4f55-880a-51b14267c4f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:16.180533 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-074085dd-7097-4f55-880a-51b14267c4f0 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1749 microversion: 2.1 time: 0.181556 Aug 05 02:25:16.181147 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 335/672] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:15 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1749 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:16.966430 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-667ba00c-03ac-45ad-8c69-ff13cc68b433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:16.967028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-667ba00c-03ac-45ad-8c69-ff13cc68b433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:16.973408 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-667ba00c-03ac-45ad-8c69-ff13cc68b433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:16.973902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-667ba00c-03ac-45ad-8c69-ff13cc68b433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:16.974327 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-667ba00c-03ac-45ad-8c69-ff13cc68b433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:16.975015 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-667ba00c-03ac-45ad-8c69-ff13cc68b433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:16.975455 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-667ba00c-03ac-45ad-8c69-ff13cc68b433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:16.975871 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-667ba00c-03ac-45ad-8c69-ff13cc68b433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:17.111086 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-667ba00c-03ac-45ad-8c69-ff13cc68b433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:17.119412 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-667ba00c-03ac-45ad-8c69-ff13cc68b433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:17.121500 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-667ba00c-03ac-45ad-8c69-ff13cc68b433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:17.122635 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-667ba00c-03ac-45ad-8c69-ff13cc68b433 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.161024 Aug 05 02:25:17.123179 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 338/673] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:16 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:17.202521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7e063224-2075-41c8-b9ea-19ed9cb727a2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:17.203116 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7e063224-2075-41c8-b9ea-19ed9cb727a2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:17.209499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e063224-2075-41c8-b9ea-19ed9cb727a2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:17.209982 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e063224-2075-41c8-b9ea-19ed9cb727a2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:17.210420 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e063224-2075-41c8-b9ea-19ed9cb727a2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:17.211108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e063224-2075-41c8-b9ea-19ed9cb727a2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:17.211565 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e063224-2075-41c8-b9ea-19ed9cb727a2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:17.211987 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e063224-2075-41c8-b9ea-19ed9cb727a2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:17.353827 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7e063224-2075-41c8-b9ea-19ed9cb727a2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:17.362403 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7e063224-2075-41c8-b9ea-19ed9cb727a2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1749 microversion: 2.1 time: 0.163861 Aug 05 02:25:17.362900 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 336/674] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:17 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:18.145118 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-18bf9526-c66d-4fc1-8ad3-956bddc68463 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:18.145752 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-18bf9526-c66d-4fc1-8ad3-956bddc68463 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:18.152502 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18bf9526-c66d-4fc1-8ad3-956bddc68463 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:18.152979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18bf9526-c66d-4fc1-8ad3-956bddc68463 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:18.153410 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18bf9526-c66d-4fc1-8ad3-956bddc68463 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:18.154088 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18bf9526-c66d-4fc1-8ad3-956bddc68463 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:18.154535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18bf9526-c66d-4fc1-8ad3-956bddc68463 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:18.154950 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18bf9526-c66d-4fc1-8ad3-956bddc68463 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:18.281808 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-18bf9526-c66d-4fc1-8ad3-956bddc68463 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:18.290103 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-18bf9526-c66d-4fc1-8ad3-956bddc68463 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:18.291618 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-18bf9526-c66d-4fc1-8ad3-956bddc68463 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:18.293412 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-18bf9526-c66d-4fc1-8ad3-956bddc68463 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.152131 Aug 05 02:25:18.293965 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 339/675] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:18 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:18.382828 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9b691bda-5c1d-43a9-b9ec-c2ec287c165e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:18.383337 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9b691bda-5c1d-43a9-b9ec-c2ec287c165e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:18.389615 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b691bda-5c1d-43a9-b9ec-c2ec287c165e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:18.390114 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b691bda-5c1d-43a9-b9ec-c2ec287c165e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:18.390541 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b691bda-5c1d-43a9-b9ec-c2ec287c165e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:18.391215 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b691bda-5c1d-43a9-b9ec-c2ec287c165e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:18.391663 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b691bda-5c1d-43a9-b9ec-c2ec287c165e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:18.392077 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9b691bda-5c1d-43a9-b9ec-c2ec287c165e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:18.533702 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9b691bda-5c1d-43a9-b9ec-c2ec287c165e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:18.541457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9b691bda-5c1d-43a9-b9ec-c2ec287c165e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1749 microversion: 2.1 time: 0.162451 Aug 05 02:25:18.542171 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 337/676] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:18 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:19.315128 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-be426666-c678-43a8-8ca0-b66143137fcb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:19.315711 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-be426666-c678-43a8-8ca0-b66143137fcb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:19.322062 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be426666-c678-43a8-8ca0-b66143137fcb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:19.322543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be426666-c678-43a8-8ca0-b66143137fcb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:19.323053 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be426666-c678-43a8-8ca0-b66143137fcb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:19.323812 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be426666-c678-43a8-8ca0-b66143137fcb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:19.324260 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be426666-c678-43a8-8ca0-b66143137fcb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:19.324706 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be426666-c678-43a8-8ca0-b66143137fcb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:19.455426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-be426666-c678-43a8-8ca0-b66143137fcb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:19.463883 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-be426666-c678-43a8-8ca0-b66143137fcb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:19.465513 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-be426666-c678-43a8-8ca0-b66143137fcb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:19.466912 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-be426666-c678-43a8-8ca0-b66143137fcb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.155714 Aug 05 02:25:19.467461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 340/677] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:19 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:19.563488 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-971c2495-9f64-4650-a92a-4e7355e871bc tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:19.564083 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-971c2495-9f64-4650-a92a-4e7355e871bc tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:19.570628 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-971c2495-9f64-4650-a92a-4e7355e871bc tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:19.571050 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-971c2495-9f64-4650-a92a-4e7355e871bc tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:19.571474 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-971c2495-9f64-4650-a92a-4e7355e871bc tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:19.572153 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-971c2495-9f64-4650-a92a-4e7355e871bc tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:19.572639 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-971c2495-9f64-4650-a92a-4e7355e871bc tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:19.573289 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-971c2495-9f64-4650-a92a-4e7355e871bc tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:19.723304 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-971c2495-9f64-4650-a92a-4e7355e871bc tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:19.732028 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-971c2495-9f64-4650-a92a-4e7355e871bc tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1749 microversion: 2.1 time: 0.172311 Aug 05 02:25:19.732636 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 338/678] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:19 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:20.489880 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d0b2efd0-3366-4c64-92b4-5dcaf932b6c8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:20.490487 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d0b2efd0-3366-4c64-92b4-5dcaf932b6c8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:20.496936 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0b2efd0-3366-4c64-92b4-5dcaf932b6c8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:20.497408 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0b2efd0-3366-4c64-92b4-5dcaf932b6c8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:20.497840 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0b2efd0-3366-4c64-92b4-5dcaf932b6c8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:20.498515 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0b2efd0-3366-4c64-92b4-5dcaf932b6c8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:20.498959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0b2efd0-3366-4c64-92b4-5dcaf932b6c8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:20.499374 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0b2efd0-3366-4c64-92b4-5dcaf932b6c8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:20.633115 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d0b2efd0-3366-4c64-92b4-5dcaf932b6c8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:20.641533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d0b2efd0-3366-4c64-92b4-5dcaf932b6c8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:20.643018 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d0b2efd0-3366-4c64-92b4-5dcaf932b6c8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:20.644158 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d0b2efd0-3366-4c64-92b4-5dcaf932b6c8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.158165 Aug 05 02:25:20.644749 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 341/679] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:20 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:20.753170 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-98016141-325b-4c96-8478-977d89f0a05a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:20.753712 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-98016141-325b-4c96-8478-977d89f0a05a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:20.759968 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98016141-325b-4c96-8478-977d89f0a05a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:20.761029 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98016141-325b-4c96-8478-977d89f0a05a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:20.761567 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98016141-325b-4c96-8478-977d89f0a05a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:20.762250 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98016141-325b-4c96-8478-977d89f0a05a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:20.762699 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98016141-325b-4c96-8478-977d89f0a05a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:20.763121 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-98016141-325b-4c96-8478-977d89f0a05a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:20.908469 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-98016141-325b-4c96-8478-977d89f0a05a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:20.916389 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-98016141-325b-4c96-8478-977d89f0a05a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1749 microversion: 2.1 time: 0.167062 Aug 05 02:25:20.916978 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 339/680] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:20 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:21.667794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bd0a5702-6d1f-4337-9544-3d4daf0409a6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:21.668442 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bd0a5702-6d1f-4337-9544-3d4daf0409a6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:21.674726 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd0a5702-6d1f-4337-9544-3d4daf0409a6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:21.675216 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd0a5702-6d1f-4337-9544-3d4daf0409a6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:21.675656 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd0a5702-6d1f-4337-9544-3d4daf0409a6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:21.676374 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd0a5702-6d1f-4337-9544-3d4daf0409a6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:21.676832 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd0a5702-6d1f-4337-9544-3d4daf0409a6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:21.677265 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd0a5702-6d1f-4337-9544-3d4daf0409a6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:21.806979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd0a5702-6d1f-4337-9544-3d4daf0409a6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:21.816024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd0a5702-6d1f-4337-9544-3d4daf0409a6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:21.817774 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bd0a5702-6d1f-4337-9544-3d4daf0409a6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:21.819074 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bd0a5702-6d1f-4337-9544-3d4daf0409a6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.155922 Aug 05 02:25:21.819704 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 342/681] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:21 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:21.937512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-819cdf58-1f67-4199-9d81-71c470634787 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:21.938158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-819cdf58-1f67-4199-9d81-71c470634787 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:21.944501 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-819cdf58-1f67-4199-9d81-71c470634787 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:21.944972 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-819cdf58-1f67-4199-9d81-71c470634787 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:21.945396 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-819cdf58-1f67-4199-9d81-71c470634787 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:21.946102 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-819cdf58-1f67-4199-9d81-71c470634787 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:21.946568 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-819cdf58-1f67-4199-9d81-71c470634787 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:21.946981 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-819cdf58-1f67-4199-9d81-71c470634787 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:22.085872 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-819cdf58-1f67-4199-9d81-71c470634787 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:22.094861 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-819cdf58-1f67-4199-9d81-71c470634787 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.161178 Aug 05 02:25:22.095435 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 340/682] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:21 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:25:22.845514 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-19d26220-3c4b-49d3-bb2d-40a32cce2bb6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:22.846133 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-19d26220-3c4b-49d3-bb2d-40a32cce2bb6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:22.852666 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19d26220-3c4b-49d3-bb2d-40a32cce2bb6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:22.853147 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19d26220-3c4b-49d3-bb2d-40a32cce2bb6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:22.853584 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19d26220-3c4b-49d3-bb2d-40a32cce2bb6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:22.854932 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19d26220-3c4b-49d3-bb2d-40a32cce2bb6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:22.855412 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19d26220-3c4b-49d3-bb2d-40a32cce2bb6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:22.855833 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19d26220-3c4b-49d3-bb2d-40a32cce2bb6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:22.989542 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-19d26220-3c4b-49d3-bb2d-40a32cce2bb6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:22.998011 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-19d26220-3c4b-49d3-bb2d-40a32cce2bb6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:22.999497 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-19d26220-3c4b-49d3-bb2d-40a32cce2bb6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:23.000660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-19d26220-3c4b-49d3-bb2d-40a32cce2bb6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.161337 Aug 05 02:25:23.001207 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 343/683] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:22 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:23.117110 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6959c069-edf7-481f-96ac-f23add32f7eb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:23.117737 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6959c069-edf7-481f-96ac-f23add32f7eb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:23.124460 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6959c069-edf7-481f-96ac-f23add32f7eb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:23.124939 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6959c069-edf7-481f-96ac-f23add32f7eb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:23.125373 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6959c069-edf7-481f-96ac-f23add32f7eb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:23.126060 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6959c069-edf7-481f-96ac-f23add32f7eb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:23.126508 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6959c069-edf7-481f-96ac-f23add32f7eb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:23.126928 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6959c069-edf7-481f-96ac-f23add32f7eb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:23.267243 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6959c069-edf7-481f-96ac-f23add32f7eb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:23.275082 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6959c069-edf7-481f-96ac-f23add32f7eb tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.161869 Aug 05 02:25:23.275639 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 341/684] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:23 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:25:24.023614 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-311c467e-00b0-4ac5-90d2-45deb403dc80 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:24.024218 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-311c467e-00b0-4ac5-90d2-45deb403dc80 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:24.030601 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-311c467e-00b0-4ac5-90d2-45deb403dc80 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:24.031072 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-311c467e-00b0-4ac5-90d2-45deb403dc80 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:24.031498 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-311c467e-00b0-4ac5-90d2-45deb403dc80 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:24.032174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-311c467e-00b0-4ac5-90d2-45deb403dc80 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:24.032655 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-311c467e-00b0-4ac5-90d2-45deb403dc80 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:24.033075 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-311c467e-00b0-4ac5-90d2-45deb403dc80 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:24.160104 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-311c467e-00b0-4ac5-90d2-45deb403dc80 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:24.169263 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-311c467e-00b0-4ac5-90d2-45deb403dc80 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:24.170780 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-311c467e-00b0-4ac5-90d2-45deb403dc80 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:24.171937 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-311c467e-00b0-4ac5-90d2-45deb403dc80 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.152238 Aug 05 02:25:24.172517 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 344/685] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:24 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:24.297861 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-35adbc0a-f52c-4a8f-ad54-32fcf3f1f81a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:24.298388 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-35adbc0a-f52c-4a8f-ad54-32fcf3f1f81a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:24.304867 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-35adbc0a-f52c-4a8f-ad54-32fcf3f1f81a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:24.305346 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-35adbc0a-f52c-4a8f-ad54-32fcf3f1f81a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:24.306197 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-35adbc0a-f52c-4a8f-ad54-32fcf3f1f81a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:24.306452 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-35adbc0a-f52c-4a8f-ad54-32fcf3f1f81a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:24.306902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-35adbc0a-f52c-4a8f-ad54-32fcf3f1f81a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:24.308002 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-35adbc0a-f52c-4a8f-ad54-32fcf3f1f81a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:24.528566 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-35adbc0a-f52c-4a8f-ad54-32fcf3f1f81a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:24.536273 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-35adbc0a-f52c-4a8f-ad54-32fcf3f1f81a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.242312 Aug 05 02:25:24.536858 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 342/686] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:24 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:25.194720 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-12155a16-babc-4da6-9e34-e459dc55e430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:25.195378 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-12155a16-babc-4da6-9e34-e459dc55e430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:25.203071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12155a16-babc-4da6-9e34-e459dc55e430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:25.203550 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12155a16-babc-4da6-9e34-e459dc55e430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:25.203985 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12155a16-babc-4da6-9e34-e459dc55e430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:25.204709 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12155a16-babc-4da6-9e34-e459dc55e430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:25.205162 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12155a16-babc-4da6-9e34-e459dc55e430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:25.205582 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-12155a16-babc-4da6-9e34-e459dc55e430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:25.331751 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-12155a16-babc-4da6-9e34-e459dc55e430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:25.340242 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-12155a16-babc-4da6-9e34-e459dc55e430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:25.342031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-12155a16-babc-4da6-9e34-e459dc55e430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:25.343220 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-12155a16-babc-4da6-9e34-e459dc55e430 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.152401 Aug 05 02:25:25.343780 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 345/687] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:25 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:25:25.558111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-11b74b52-5127-4ddb-b9c1-9c1a5e407756 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:25.558703 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-11b74b52-5127-4ddb-b9c1-9c1a5e407756 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:25.564910 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-11b74b52-5127-4ddb-b9c1-9c1a5e407756 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:25.565387 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-11b74b52-5127-4ddb-b9c1-9c1a5e407756 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:25.565819 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-11b74b52-5127-4ddb-b9c1-9c1a5e407756 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:25.566502 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-11b74b52-5127-4ddb-b9c1-9c1a5e407756 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:25.566952 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-11b74b52-5127-4ddb-b9c1-9c1a5e407756 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:25.567373 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-11b74b52-5127-4ddb-b9c1-9c1a5e407756 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:25.715452 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-11b74b52-5127-4ddb-b9c1-9c1a5e407756 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:25.723493 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-11b74b52-5127-4ddb-b9c1-9c1a5e407756 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.169915 Aug 05 02:25:25.724051 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 343/688] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:25 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:26.365690 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c05e6358-d6f5-4b52-8927-2cb3f1848a6d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:26.366211 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c05e6358-d6f5-4b52-8927-2cb3f1848a6d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:26.372501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c05e6358-d6f5-4b52-8927-2cb3f1848a6d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:26.372983 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c05e6358-d6f5-4b52-8927-2cb3f1848a6d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:26.373409 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c05e6358-d6f5-4b52-8927-2cb3f1848a6d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:26.374084 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c05e6358-d6f5-4b52-8927-2cb3f1848a6d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:26.374531 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c05e6358-d6f5-4b52-8927-2cb3f1848a6d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:26.374946 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c05e6358-d6f5-4b52-8927-2cb3f1848a6d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:26.503677 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c05e6358-d6f5-4b52-8927-2cb3f1848a6d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:26.511936 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c05e6358-d6f5-4b52-8927-2cb3f1848a6d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:26.513447 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c05e6358-d6f5-4b52-8927-2cb3f1848a6d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:26.514588 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c05e6358-d6f5-4b52-8927-2cb3f1848a6d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.153007 Aug 05 02:25:26.515133 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 346/689] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:26 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:26.745842 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-47004c0e-81d6-4540-a2b3-7a4eb5b1f5b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:26.746437 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-47004c0e-81d6-4540-a2b3-7a4eb5b1f5b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:26.753707 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47004c0e-81d6-4540-a2b3-7a4eb5b1f5b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:26.754209 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47004c0e-81d6-4540-a2b3-7a4eb5b1f5b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:26.754624 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47004c0e-81d6-4540-a2b3-7a4eb5b1f5b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:26.755374 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47004c0e-81d6-4540-a2b3-7a4eb5b1f5b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:26.756009 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47004c0e-81d6-4540-a2b3-7a4eb5b1f5b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:26.756550 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47004c0e-81d6-4540-a2b3-7a4eb5b1f5b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:26.897941 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-47004c0e-81d6-4540-a2b3-7a4eb5b1f5b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:26.906406 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-47004c0e-81d6-4540-a2b3-7a4eb5b1f5b3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.164674 Aug 05 02:25:26.906968 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 344/690] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:26 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:27.537996 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e21999a3-9a34-4fdf-8df1-b867c91754a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:27.538599 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e21999a3-9a34-4fdf-8df1-b867c91754a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:27.545276 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e21999a3-9a34-4fdf-8df1-b867c91754a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:27.545756 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e21999a3-9a34-4fdf-8df1-b867c91754a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:27.546184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e21999a3-9a34-4fdf-8df1-b867c91754a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:27.546860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e21999a3-9a34-4fdf-8df1-b867c91754a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:27.547304 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e21999a3-9a34-4fdf-8df1-b867c91754a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:27.547720 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e21999a3-9a34-4fdf-8df1-b867c91754a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:27.680214 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e21999a3-9a34-4fdf-8df1-b867c91754a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:27.689599 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e21999a3-9a34-4fdf-8df1-b867c91754a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:27.691093 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e21999a3-9a34-4fdf-8df1-b867c91754a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:27.692286 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e21999a3-9a34-4fdf-8df1-b867c91754a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.158133 Aug 05 02:25:27.692877 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 347/691] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:27 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:27.928044 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ec5d5d65-e6f9-43f3-9b2a-dafaf550a8ed tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:27.928675 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ec5d5d65-e6f9-43f3-9b2a-dafaf550a8ed tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:27.935178 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ec5d5d65-e6f9-43f3-9b2a-dafaf550a8ed tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:27.935652 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ec5d5d65-e6f9-43f3-9b2a-dafaf550a8ed tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:27.936081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ec5d5d65-e6f9-43f3-9b2a-dafaf550a8ed tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:27.936795 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ec5d5d65-e6f9-43f3-9b2a-dafaf550a8ed tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:27.937242 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ec5d5d65-e6f9-43f3-9b2a-dafaf550a8ed tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:27.937659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ec5d5d65-e6f9-43f3-9b2a-dafaf550a8ed tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:28.086312 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ec5d5d65-e6f9-43f3-9b2a-dafaf550a8ed tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:28.097439 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ec5d5d65-e6f9-43f3-9b2a-dafaf550a8ed tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.173036 Aug 05 02:25:28.101679 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 345/692] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:27 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:28.715206 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a965ab9f-9b5f-40dd-865b-6872feff4def tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:28.716107 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a965ab9f-9b5f-40dd-865b-6872feff4def tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:28.722525 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a965ab9f-9b5f-40dd-865b-6872feff4def tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:28.723013 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a965ab9f-9b5f-40dd-865b-6872feff4def tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:28.723445 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a965ab9f-9b5f-40dd-865b-6872feff4def tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:28.724132 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a965ab9f-9b5f-40dd-865b-6872feff4def tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:28.724610 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a965ab9f-9b5f-40dd-865b-6872feff4def tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:28.725036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a965ab9f-9b5f-40dd-865b-6872feff4def tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:28.857031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a965ab9f-9b5f-40dd-865b-6872feff4def tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:28.865280 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a965ab9f-9b5f-40dd-865b-6872feff4def tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:28.866773 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a965ab9f-9b5f-40dd-865b-6872feff4def tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:28.867931 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a965ab9f-9b5f-40dd-865b-6872feff4def tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.157114 Aug 05 02:25:28.868507 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 348/693] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:28 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:29.122651 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7a2c4ade-be72-4ee0-b8c8-4c952dd69c7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:29.123189 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7a2c4ade-be72-4ee0-b8c8-4c952dd69c7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:29.129753 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7a2c4ade-be72-4ee0-b8c8-4c952dd69c7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:29.130233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7a2c4ade-be72-4ee0-b8c8-4c952dd69c7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:29.130665 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7a2c4ade-be72-4ee0-b8c8-4c952dd69c7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:29.131347 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7a2c4ade-be72-4ee0-b8c8-4c952dd69c7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:29.131797 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7a2c4ade-be72-4ee0-b8c8-4c952dd69c7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:29.132215 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7a2c4ade-be72-4ee0-b8c8-4c952dd69c7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:29.279665 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7a2c4ade-be72-4ee0-b8c8-4c952dd69c7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:29.287593 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7a2c4ade-be72-4ee0-b8c8-4c952dd69c7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.169634 Aug 05 02:25:29.288154 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 346/694] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:29 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:29.891093 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5fee06c5-0487-49fc-8423-b80fa75bb60b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:29.891729 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5fee06c5-0487-49fc-8423-b80fa75bb60b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:29.898151 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5fee06c5-0487-49fc-8423-b80fa75bb60b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:29.898632 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5fee06c5-0487-49fc-8423-b80fa75bb60b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:29.899066 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5fee06c5-0487-49fc-8423-b80fa75bb60b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:29.899804 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5fee06c5-0487-49fc-8423-b80fa75bb60b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:29.900254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5fee06c5-0487-49fc-8423-b80fa75bb60b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:29.900759 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5fee06c5-0487-49fc-8423-b80fa75bb60b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:30.042337 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5fee06c5-0487-49fc-8423-b80fa75bb60b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:30.050643 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5fee06c5-0487-49fc-8423-b80fa75bb60b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:30.052185 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5fee06c5-0487-49fc-8423-b80fa75bb60b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:30.053355 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5fee06c5-0487-49fc-8423-b80fa75bb60b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.166162 Aug 05 02:25:30.053908 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 349/695] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:29 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:30.310530 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3f95835c-66f0-4aa9-a60d-0d9e5e1db6e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:30.311168 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3f95835c-66f0-4aa9-a60d-0d9e5e1db6e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:30.317534 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3f95835c-66f0-4aa9-a60d-0d9e5e1db6e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:30.318016 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3f95835c-66f0-4aa9-a60d-0d9e5e1db6e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:30.318455 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3f95835c-66f0-4aa9-a60d-0d9e5e1db6e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:30.319141 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3f95835c-66f0-4aa9-a60d-0d9e5e1db6e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:30.319595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3f95835c-66f0-4aa9-a60d-0d9e5e1db6e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:30.320018 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3f95835c-66f0-4aa9-a60d-0d9e5e1db6e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:30.462298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3f95835c-66f0-4aa9-a60d-0d9e5e1db6e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:30.471438 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3f95835c-66f0-4aa9-a60d-0d9e5e1db6e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.165005 Aug 05 02:25:30.472007 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 347/696] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:30 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:31.077531 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f7f6897a-c4cd-4e15-9806-52225a681dc0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:31.078139 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f7f6897a-c4cd-4e15-9806-52225a681dc0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:31.084598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f7f6897a-c4cd-4e15-9806-52225a681dc0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:31.085018 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f7f6897a-c4cd-4e15-9806-52225a681dc0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:31.085453 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f7f6897a-c4cd-4e15-9806-52225a681dc0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:31.086135 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f7f6897a-c4cd-4e15-9806-52225a681dc0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:31.086585 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f7f6897a-c4cd-4e15-9806-52225a681dc0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:31.087008 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f7f6897a-c4cd-4e15-9806-52225a681dc0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:31.220836 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f7f6897a-c4cd-4e15-9806-52225a681dc0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:31.229837 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f7f6897a-c4cd-4e15-9806-52225a681dc0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:31.231349 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f7f6897a-c4cd-4e15-9806-52225a681dc0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:31.232532 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f7f6897a-c4cd-4e15-9806-52225a681dc0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.158876 Aug 05 02:25:31.233095 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 350/697] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:31 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:31.360505 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-aa5b449a-dc3d-4659-b3bc-4aaee09d1342 req-c7675fde-bd39-4822-88ac-3504f5779f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319a8a64-7b50-4fff-93b6-4498b53265ab", "name": "network-vif-plugged", "status": "completed", "tag": "661635b8-8836-4704-91ee-343c5d3a40eb"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:25:31.371774 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-aa5b449a-dc3d-4659-b3bc-4aaee09d1342 req-c7675fde-bd39-4822-88ac-3504f5779f49 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:31.372893 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-aa5b449a-dc3d-4659-b3bc-4aaee09d1342 req-c7675fde-bd39-4822-88ac-3504f5779f49 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:31.373321 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-aa5b449a-dc3d-4659-b3bc-4aaee09d1342 req-c7675fde-bd39-4822-88ac-3504f5779f49 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:31.384361 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-aa5b449a-dc3d-4659-b3bc-4aaee09d1342 req-c7675fde-bd39-4822-88ac-3504f5779f49 service nova] Creating event network-vif-plugged:661635b8-8836-4704-91ee-343c5d3a40eb for instance 319a8a64-7b50-4fff-93b6-4498b53265ab on hv-cinder-81558 Aug 05 02:25:31.389372 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-aa5b449a-dc3d-4659-b3bc-4aaee09d1342 req-c7675fde-bd39-4822-88ac-3504f5779f49 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032521 Aug 05 02:25:31.390220 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 348/698] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:25:31.492755 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4e0c6acb-118e-4331-9c74-77fa5c3e15dd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:31.493365 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4e0c6acb-118e-4331-9c74-77fa5c3e15dd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:31.500092 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e0c6acb-118e-4331-9c74-77fa5c3e15dd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:31.500606 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e0c6acb-118e-4331-9c74-77fa5c3e15dd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:31.501038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e0c6acb-118e-4331-9c74-77fa5c3e15dd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:31.501719 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e0c6acb-118e-4331-9c74-77fa5c3e15dd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:31.502164 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e0c6acb-118e-4331-9c74-77fa5c3e15dd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:31.502608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e0c6acb-118e-4331-9c74-77fa5c3e15dd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:31.643144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4e0c6acb-118e-4331-9c74-77fa5c3e15dd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:31.651588 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4e0c6acb-118e-4331-9c74-77fa5c3e15dd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.162650 Aug 05 02:25:31.652129 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 351/699] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:31 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:32.256094 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5c55f61e-258d-45f6-9006-eabf599e6f1c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:32.256837 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5c55f61e-258d-45f6-9006-eabf599e6f1c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:32.263651 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c55f61e-258d-45f6-9006-eabf599e6f1c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:32.264127 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c55f61e-258d-45f6-9006-eabf599e6f1c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:32.264594 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c55f61e-258d-45f6-9006-eabf599e6f1c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:32.265305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c55f61e-258d-45f6-9006-eabf599e6f1c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:32.265754 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c55f61e-258d-45f6-9006-eabf599e6f1c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:32.266180 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c55f61e-258d-45f6-9006-eabf599e6f1c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:32.393869 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5c55f61e-258d-45f6-9006-eabf599e6f1c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:32.402351 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5c55f61e-258d-45f6-9006-eabf599e6f1c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:32.403851 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5c55f61e-258d-45f6-9006-eabf599e6f1c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:32.405050 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5c55f61e-258d-45f6-9006-eabf599e6f1c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.153420 Aug 05 02:25:32.405602 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 349/700] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:32 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:32.673125 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fba9c470-30db-4ae9-97b2-1a11dc95fded tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:32.673757 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fba9c470-30db-4ae9-97b2-1a11dc95fded tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:32.680119 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fba9c470-30db-4ae9-97b2-1a11dc95fded tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:32.680619 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fba9c470-30db-4ae9-97b2-1a11dc95fded tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:32.681046 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fba9c470-30db-4ae9-97b2-1a11dc95fded tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:32.682206 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fba9c470-30db-4ae9-97b2-1a11dc95fded tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:32.682675 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fba9c470-30db-4ae9-97b2-1a11dc95fded tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:32.683146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fba9c470-30db-4ae9-97b2-1a11dc95fded tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:32.822921 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fba9c470-30db-4ae9-97b2-1a11dc95fded tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:32.830863 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fba9c470-30db-4ae9-97b2-1a11dc95fded tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.161505 Aug 05 02:25:32.831434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 352/701] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:32 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:33.427674 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-95b03b29-1935-4dc9-866a-da573c22da0b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:33.428272 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-95b03b29-1935-4dc9-866a-da573c22da0b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:33.434721 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95b03b29-1935-4dc9-866a-da573c22da0b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:33.435195 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95b03b29-1935-4dc9-866a-da573c22da0b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:33.435623 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95b03b29-1935-4dc9-866a-da573c22da0b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:33.436302 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95b03b29-1935-4dc9-866a-da573c22da0b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:33.436771 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95b03b29-1935-4dc9-866a-da573c22da0b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:33.437188 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95b03b29-1935-4dc9-866a-da573c22da0b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:33.562496 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-95b03b29-1935-4dc9-866a-da573c22da0b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:33.570646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-95b03b29-1935-4dc9-866a-da573c22da0b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:33.572674 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-95b03b29-1935-4dc9-866a-da573c22da0b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:33.573924 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-95b03b29-1935-4dc9-866a-da573c22da0b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.150159 Aug 05 02:25:33.574477 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 350/702] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:33 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:33.851860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1d6929f4-38ef-4139-9f90-ca7a5c94b5ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:33.852502 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1d6929f4-38ef-4139-9f90-ca7a5c94b5ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:33.855904 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=47 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:25:33.859661 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d6929f4-38ef-4139-9f90-ca7a5c94b5ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:33.860144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d6929f4-38ef-4139-9f90-ca7a5c94b5ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:33.860603 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d6929f4-38ef-4139-9f90-ca7a5c94b5ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:33.861284 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d6929f4-38ef-4139-9f90-ca7a5c94b5ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:33.861732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d6929f4-38ef-4139-9f90-ca7a5c94b5ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:33.862149 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d6929f4-38ef-4139-9f90-ca7a5c94b5ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:33.880505 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:25:34.010687 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1d6929f4-38ef-4139-9f90-ca7a5c94b5ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:34.018575 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1d6929f4-38ef-4139-9f90-ca7a5c94b5ec tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.170550 Aug 05 02:25:34.019137 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 353/703] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:33 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:34.647821 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b72c409a-c15a-4859-bf5f-39e6d21f0ef7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:34.648457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b72c409a-c15a-4859-bf5f-39e6d21f0ef7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:34.654867 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b72c409a-c15a-4859-bf5f-39e6d21f0ef7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:34.655347 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b72c409a-c15a-4859-bf5f-39e6d21f0ef7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:34.655786 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b72c409a-c15a-4859-bf5f-39e6d21f0ef7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:34.656511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b72c409a-c15a-4859-bf5f-39e6d21f0ef7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:34.656969 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b72c409a-c15a-4859-bf5f-39e6d21f0ef7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:34.657400 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b72c409a-c15a-4859-bf5f-39e6d21f0ef7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:34.798512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b72c409a-c15a-4859-bf5f-39e6d21f0ef7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:34.801942 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=100 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:25:34.808586 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b72c409a-c15a-4859-bf5f-39e6d21f0ef7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:34.810071 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b72c409a-c15a-4859-bf5f-39e6d21f0ef7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:34.811217 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b72c409a-c15a-4859-bf5f-39e6d21f0ef7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1807 microversion: 2.20 time: 0.217808 Aug 05 02:25:34.811758 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 351/704] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:34 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:35.040036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8ffee6bf-26cb-4f2f-a8f5-4a14bc7d02c1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:35.040675 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8ffee6bf-26cb-4f2f-a8f5-4a14bc7d02c1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:35.047437 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ffee6bf-26cb-4f2f-a8f5-4a14bc7d02c1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:35.047860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ffee6bf-26cb-4f2f-a8f5-4a14bc7d02c1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:35.048294 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ffee6bf-26cb-4f2f-a8f5-4a14bc7d02c1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:35.049013 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ffee6bf-26cb-4f2f-a8f5-4a14bc7d02c1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:35.049467 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ffee6bf-26cb-4f2f-a8f5-4a14bc7d02c1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:35.049888 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ffee6bf-26cb-4f2f-a8f5-4a14bc7d02c1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:35.196157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8ffee6bf-26cb-4f2f-a8f5-4a14bc7d02c1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:35.204673 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8ffee6bf-26cb-4f2f-a8f5-4a14bc7d02c1 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.168436 Aug 05 02:25:35.205235 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 354/705] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:35 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:35.834743 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-57177a95-1c1d-4d51-aa6d-5996784923b4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:35.835345 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-57177a95-1c1d-4d51-aa6d-5996784923b4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:35.842969 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57177a95-1c1d-4d51-aa6d-5996784923b4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:35.843450 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57177a95-1c1d-4d51-aa6d-5996784923b4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:35.843883 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57177a95-1c1d-4d51-aa6d-5996784923b4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:35.844602 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57177a95-1c1d-4d51-aa6d-5996784923b4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:35.845052 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57177a95-1c1d-4d51-aa6d-5996784923b4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:35.845501 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57177a95-1c1d-4d51-aa6d-5996784923b4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:35.979043 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-57177a95-1c1d-4d51-aa6d-5996784923b4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:35.987324 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-57177a95-1c1d-4d51-aa6d-5996784923b4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:35.988825 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-57177a95-1c1d-4d51-aa6d-5996784923b4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:35.989991 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-57177a95-1c1d-4d51-aa6d-5996784923b4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1794 microversion: 2.20 time: 0.159158 Aug 05 02:25:35.990544 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 352/706] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:25:35 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1794 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:25:36.226766 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-283e6274-ec43-4db3-b4fd-400c44b56e3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:36.227313 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-283e6274-ec43-4db3-b4fd-400c44b56e3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:36.234310 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-283e6274-ec43-4db3-b4fd-400c44b56e3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:36.234778 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-283e6274-ec43-4db3-b4fd-400c44b56e3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:36.235202 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-283e6274-ec43-4db3-b4fd-400c44b56e3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:36.235877 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-283e6274-ec43-4db3-b4fd-400c44b56e3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:36.236318 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-283e6274-ec43-4db3-b4fd-400c44b56e3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:36.236756 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-283e6274-ec43-4db3-b4fd-400c44b56e3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:36.381166 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-283e6274-ec43-4db3-b4fd-400c44b56e3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:36.390132 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-283e6274-ec43-4db3-b4fd-400c44b56e3f tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.167242 Aug 05 02:25:36.390695 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 355/707] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:36 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:37.411213 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6442b459-449e-4e3b-890f-5d7fb3ffd39b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:37.411820 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6442b459-449e-4e3b-890f-5d7fb3ffd39b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:37.418996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6442b459-449e-4e3b-890f-5d7fb3ffd39b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:37.419471 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6442b459-449e-4e3b-890f-5d7fb3ffd39b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:37.419906 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6442b459-449e-4e3b-890f-5d7fb3ffd39b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:37.420611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6442b459-449e-4e3b-890f-5d7fb3ffd39b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:37.421071 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6442b459-449e-4e3b-890f-5d7fb3ffd39b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:37.421493 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6442b459-449e-4e3b-890f-5d7fb3ffd39b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:37.564987 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6442b459-449e-4e3b-890f-5d7fb3ffd39b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:37.572767 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6442b459-449e-4e3b-890f-5d7fb3ffd39b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.165471 Aug 05 02:25:37.573431 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 353/708] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:37 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:38.199593 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a2e079e7-7676-49bd-b5b0-92065fb63c18 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9048f0f-0033-41ff-aa66-8f255f6704ff"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:25:38.202093 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a2e079e7-7676-49bd-b5b0-92065fb63c18 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:38.207929 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2e079e7-7676-49bd-b5b0-92065fb63c18 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:38.208436 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2e079e7-7676-49bd-b5b0-92065fb63c18 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:38.208870 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2e079e7-7676-49bd-b5b0-92065fb63c18 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:38.209557 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2e079e7-7676-49bd-b5b0-92065fb63c18 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:38.210013 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2e079e7-7676-49bd-b5b0-92065fb63c18 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:38.210442 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2e079e7-7676-49bd-b5b0-92065fb63c18 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:38.471881 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a2e079e7-7676-49bd-b5b0-92065fb63c18 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "POST /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378329 Aug 05 02:25:38.472509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 356/709] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Aug 5 02:25:38 2022] POST /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:25:38.593274 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5c4b0d4c-2ef2-43b8-b3a6-ca12ef2ee819 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:38.593880 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5c4b0d4c-2ef2-43b8-b3a6-ca12ef2ee819 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:38.596146 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=52 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:25:38.602422 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c4b0d4c-2ef2-43b8-b3a6-ca12ef2ee819 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:38.602810 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c4b0d4c-2ef2-43b8-b3a6-ca12ef2ee819 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:38.603270 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c4b0d4c-2ef2-43b8-b3a6-ca12ef2ee819 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:38.604167 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c4b0d4c-2ef2-43b8-b3a6-ca12ef2ee819 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:38.604811 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c4b0d4c-2ef2-43b8-b3a6-ca12ef2ee819 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:38.605233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5c4b0d4c-2ef2-43b8-b3a6-ca12ef2ee819 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:38.749422 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5c4b0d4c-2ef2-43b8-b3a6-ca12ef2ee819 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:38.757542 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5c4b0d4c-2ef2-43b8-b3a6-ca12ef2ee819 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.168381 Aug 05 02:25:38.758109 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 354/710] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:38 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:39.780828 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0cedd223-ae16-4834-8a3f-d76ee60f21df tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:39.781561 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0cedd223-ae16-4834-8a3f-d76ee60f21df tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:39.787772 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cedd223-ae16-4834-8a3f-d76ee60f21df tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:39.788255 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cedd223-ae16-4834-8a3f-d76ee60f21df tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:39.788721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cedd223-ae16-4834-8a3f-d76ee60f21df tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:39.789404 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cedd223-ae16-4834-8a3f-d76ee60f21df tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:39.789866 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cedd223-ae16-4834-8a3f-d76ee60f21df tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:39.790291 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cedd223-ae16-4834-8a3f-d76ee60f21df tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:39.931850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0cedd223-ae16-4834-8a3f-d76ee60f21df tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:39.940443 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0cedd223-ae16-4834-8a3f-d76ee60f21df tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.165067 Aug 05 02:25:39.941005 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 357/711] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:39 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:40.961726 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5f48e79d-3492-4a9b-a4aa-75434f966efe tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:40.962330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5f48e79d-3492-4a9b-a4aa-75434f966efe tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:40.969177 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f48e79d-3492-4a9b-a4aa-75434f966efe tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:40.969646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f48e79d-3492-4a9b-a4aa-75434f966efe tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:40.970070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f48e79d-3492-4a9b-a4aa-75434f966efe tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:40.970739 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f48e79d-3492-4a9b-a4aa-75434f966efe tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:40.971179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f48e79d-3492-4a9b-a4aa-75434f966efe tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:40.971591 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5f48e79d-3492-4a9b-a4aa-75434f966efe tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:41.112858 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5f48e79d-3492-4a9b-a4aa-75434f966efe tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:41.121249 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5f48e79d-3492-4a9b-a4aa-75434f966efe tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.162718 Aug 05 02:25:41.121814 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 355/712] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:40 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:42.142476 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fd7d9262-28ba-4043-b313-53ada61c8b9a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:42.143083 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fd7d9262-28ba-4043-b313-53ada61c8b9a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:42.149554 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd7d9262-28ba-4043-b313-53ada61c8b9a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:42.150028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd7d9262-28ba-4043-b313-53ada61c8b9a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:42.150460 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd7d9262-28ba-4043-b313-53ada61c8b9a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:42.151139 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd7d9262-28ba-4043-b313-53ada61c8b9a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:42.152218 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd7d9262-28ba-4043-b313-53ada61c8b9a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:42.152669 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd7d9262-28ba-4043-b313-53ada61c8b9a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:42.301797 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fd7d9262-28ba-4043-b313-53ada61c8b9a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:42.309819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fd7d9262-28ba-4043-b313-53ada61c8b9a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.171142 Aug 05 02:25:42.310387 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 358/713] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:42 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:43.330886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ae9bd7f4-6fb0-4387-b32f-14d0fd63e71a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:43.331486 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ae9bd7f4-6fb0-4387-b32f-14d0fd63e71a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:43.337829 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae9bd7f4-6fb0-4387-b32f-14d0fd63e71a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:43.338306 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae9bd7f4-6fb0-4387-b32f-14d0fd63e71a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:43.338729 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae9bd7f4-6fb0-4387-b32f-14d0fd63e71a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:43.339911 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae9bd7f4-6fb0-4387-b32f-14d0fd63e71a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:43.340648 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae9bd7f4-6fb0-4387-b32f-14d0fd63e71a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:43.341063 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ae9bd7f4-6fb0-4387-b32f-14d0fd63e71a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:43.479072 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ae9bd7f4-6fb0-4387-b32f-14d0fd63e71a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:43.487721 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ae9bd7f4-6fb0-4387-b32f-14d0fd63e71a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.160646 Aug 05 02:25:43.488278 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 356/714] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:43 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:44.509045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0019bdef-6b58-4150-9adc-15870f9e7517 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:44.509652 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0019bdef-6b58-4150-9adc-15870f9e7517 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:44.516608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0019bdef-6b58-4150-9adc-15870f9e7517 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:44.517085 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0019bdef-6b58-4150-9adc-15870f9e7517 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:44.517519 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0019bdef-6b58-4150-9adc-15870f9e7517 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:44.518199 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0019bdef-6b58-4150-9adc-15870f9e7517 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:44.518648 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0019bdef-6b58-4150-9adc-15870f9e7517 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:44.519067 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0019bdef-6b58-4150-9adc-15870f9e7517 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:44.658253 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0019bdef-6b58-4150-9adc-15870f9e7517 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:44.666111 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0019bdef-6b58-4150-9adc-15870f9e7517 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1754 microversion: 2.1 time: 0.160964 Aug 05 02:25:44.666674 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 359/715] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:44 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:45.688475 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2f647f1d-b16a-4330-a228-92c0d65bde85 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:45.689661 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2f647f1d-b16a-4330-a228-92c0d65bde85 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:45.697241 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2f647f1d-b16a-4330-a228-92c0d65bde85 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:45.697730 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2f647f1d-b16a-4330-a228-92c0d65bde85 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:45.698165 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2f647f1d-b16a-4330-a228-92c0d65bde85 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:45.699498 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2f647f1d-b16a-4330-a228-92c0d65bde85 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:45.700031 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2f647f1d-b16a-4330-a228-92c0d65bde85 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:45.700493 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2f647f1d-b16a-4330-a228-92c0d65bde85 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:45.847260 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2f647f1d-b16a-4330-a228-92c0d65bde85 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:45.855668 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2f647f1d-b16a-4330-a228-92c0d65bde85 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1757 microversion: 2.1 time: 0.170977 Aug 05 02:25:45.856238 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 357/716] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:45 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:47.046965 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-115264f6-11ef-4471-970d-6b2037591658 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:25:47.049295 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-115264f6-11ef-4471-970d-6b2037591658 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:47.055623 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-115264f6-11ef-4471-970d-6b2037591658 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:47.056103 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-115264f6-11ef-4471-970d-6b2037591658 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:47.056566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-115264f6-11ef-4471-970d-6b2037591658 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:47.057248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-115264f6-11ef-4471-970d-6b2037591658 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:47.057748 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-115264f6-11ef-4471-970d-6b2037591658 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:47.058267 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-115264f6-11ef-4471-970d-6b2037591658 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:47.080776 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-115264f6-11ef-4471-970d-6b2037591658 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lazy-loading 'flavor' on Instance uuid 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:25:47.201450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-115264f6-11ef-4471-970d-6b2037591658 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "POST /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/action" status: 200 len: 32 microversion: 2.1 time: 0.159088 Aug 05 02:25:47.202094 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 360/717] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Aug 5 02:25:47 2022] POST /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 02:25:47.211908 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a2e98687-2214-4642-958c-88cd34ba23e6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:47.212631 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a2e98687-2214-4642-958c-88cd34ba23e6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:47.220715 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2e98687-2214-4642-958c-88cd34ba23e6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:47.221444 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2e98687-2214-4642-958c-88cd34ba23e6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:47.221669 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2e98687-2214-4642-958c-88cd34ba23e6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:47.222360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2e98687-2214-4642-958c-88cd34ba23e6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:47.222872 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2e98687-2214-4642-958c-88cd34ba23e6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:47.223422 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2e98687-2214-4642-958c-88cd34ba23e6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:47.656984 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a2e98687-2214-4642-958c-88cd34ba23e6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:47.664707 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a2e98687-2214-4642-958c-88cd34ba23e6 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.457119 Aug 05 02:25:47.665280 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 358/718] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:47 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:48.687758 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c2cb83e4-869f-4d1a-b4ce-0e0b9df78b07 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:48.688473 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c2cb83e4-869f-4d1a-b4ce-0e0b9df78b07 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:48.694574 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2cb83e4-869f-4d1a-b4ce-0e0b9df78b07 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:48.695050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2cb83e4-869f-4d1a-b4ce-0e0b9df78b07 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:48.695481 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2cb83e4-869f-4d1a-b4ce-0e0b9df78b07 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:48.696155 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2cb83e4-869f-4d1a-b4ce-0e0b9df78b07 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:48.696670 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2cb83e4-869f-4d1a-b4ce-0e0b9df78b07 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:48.697087 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2cb83e4-869f-4d1a-b4ce-0e0b9df78b07 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:48.825232 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c2cb83e4-869f-4d1a-b4ce-0e0b9df78b07 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:48.833181 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c2cb83e4-869f-4d1a-b4ce-0e0b9df78b07 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.150685 Aug 05 02:25:48.833744 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 361/719] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:48 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:49.855673 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-153c67a1-082d-4467-9147-5d8d67f70e90 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:49.856280 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-153c67a1-082d-4467-9147-5d8d67f70e90 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:49.862667 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-153c67a1-082d-4467-9147-5d8d67f70e90 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:49.863156 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-153c67a1-082d-4467-9147-5d8d67f70e90 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:49.863647 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-153c67a1-082d-4467-9147-5d8d67f70e90 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:49.864275 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-153c67a1-082d-4467-9147-5d8d67f70e90 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:49.864908 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-153c67a1-082d-4467-9147-5d8d67f70e90 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:49.865332 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-153c67a1-082d-4467-9147-5d8d67f70e90 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:49.995294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-153c67a1-082d-4467-9147-5d8d67f70e90 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:50.003722 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-153c67a1-082d-4467-9147-5d8d67f70e90 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.151968 Aug 05 02:25:50.004616 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 359/720] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:49 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:51.025578 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-92689672-5b8d-4562-8d2b-d0951eaca2ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:51.026180 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-92689672-5b8d-4562-8d2b-d0951eaca2ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:51.032699 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92689672-5b8d-4562-8d2b-d0951eaca2ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:51.033171 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92689672-5b8d-4562-8d2b-d0951eaca2ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:51.033599 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92689672-5b8d-4562-8d2b-d0951eaca2ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:51.034274 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92689672-5b8d-4562-8d2b-d0951eaca2ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:51.034723 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92689672-5b8d-4562-8d2b-d0951eaca2ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:51.035142 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92689672-5b8d-4562-8d2b-d0951eaca2ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:51.166856 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-92689672-5b8d-4562-8d2b-d0951eaca2ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:51.175383 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-92689672-5b8d-4562-8d2b-d0951eaca2ce tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.153661 Aug 05 02:25:51.175949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 362/721] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:51 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:52.196655 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cbcaba97-4ec6-4f85-bce2-6c94736aaf84 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:52.197265 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cbcaba97-4ec6-4f85-bce2-6c94736aaf84 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:52.204318 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbcaba97-4ec6-4f85-bce2-6c94736aaf84 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:52.204835 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbcaba97-4ec6-4f85-bce2-6c94736aaf84 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:52.205273 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbcaba97-4ec6-4f85-bce2-6c94736aaf84 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:52.205961 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbcaba97-4ec6-4f85-bce2-6c94736aaf84 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:52.206414 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbcaba97-4ec6-4f85-bce2-6c94736aaf84 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:52.206839 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cbcaba97-4ec6-4f85-bce2-6c94736aaf84 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:52.338743 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cbcaba97-4ec6-4f85-bce2-6c94736aaf84 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:52.347464 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cbcaba97-4ec6-4f85-bce2-6c94736aaf84 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.154670 Aug 05 02:25:52.348022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 360/722] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:52 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:53.368505 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-de63068e-e9af-4978-b314-0848296483aa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:53.369115 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-de63068e-e9af-4978-b314-0848296483aa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:53.375889 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de63068e-e9af-4978-b314-0848296483aa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:53.376410 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de63068e-e9af-4978-b314-0848296483aa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:53.376849 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de63068e-e9af-4978-b314-0848296483aa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:53.377536 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de63068e-e9af-4978-b314-0848296483aa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:53.377989 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de63068e-e9af-4978-b314-0848296483aa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:53.378408 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de63068e-e9af-4978-b314-0848296483aa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:53.505965 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-de63068e-e9af-4978-b314-0848296483aa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:53.514449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-de63068e-e9af-4978-b314-0848296483aa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.149810 Aug 05 02:25:53.515005 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 363/723] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:53 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:54.535752 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8fe5b11f-945b-4a81-8449-c31e4c8c351c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:54.536401 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8fe5b11f-945b-4a81-8449-c31e4c8c351c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:54.543448 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8fe5b11f-945b-4a81-8449-c31e4c8c351c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:54.543915 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8fe5b11f-945b-4a81-8449-c31e4c8c351c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:54.544360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8fe5b11f-945b-4a81-8449-c31e4c8c351c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:54.545040 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8fe5b11f-945b-4a81-8449-c31e4c8c351c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:54.545484 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8fe5b11f-945b-4a81-8449-c31e4c8c351c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:54.545897 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8fe5b11f-945b-4a81-8449-c31e4c8c351c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:54.671414 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8fe5b11f-945b-4a81-8449-c31e4c8c351c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:54.679212 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8fe5b11f-945b-4a81-8449-c31e4c8c351c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.147265 Aug 05 02:25:54.679774 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 361/724] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:54 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:55.701157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fc90bd3d-e0c6-45f8-9568-83a308aa0114 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:55.701756 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fc90bd3d-e0c6-45f8-9568-83a308aa0114 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:55.708155 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc90bd3d-e0c6-45f8-9568-83a308aa0114 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:55.708656 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc90bd3d-e0c6-45f8-9568-83a308aa0114 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:55.709086 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc90bd3d-e0c6-45f8-9568-83a308aa0114 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:55.709760 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc90bd3d-e0c6-45f8-9568-83a308aa0114 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:55.710205 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc90bd3d-e0c6-45f8-9568-83a308aa0114 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:55.710629 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc90bd3d-e0c6-45f8-9568-83a308aa0114 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:55.843754 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fc90bd3d-e0c6-45f8-9568-83a308aa0114 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:55.851660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fc90bd3d-e0c6-45f8-9568-83a308aa0114 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.154518 Aug 05 02:25:55.852209 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 364/725] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:55 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:56.873323 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3b054693-7080-4542-b4c1-9c72a267824c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:56.873920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3b054693-7080-4542-b4c1-9c72a267824c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:56.880374 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3b054693-7080-4542-b4c1-9c72a267824c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:56.880848 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3b054693-7080-4542-b4c1-9c72a267824c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:56.881273 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3b054693-7080-4542-b4c1-9c72a267824c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:56.881943 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3b054693-7080-4542-b4c1-9c72a267824c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:56.882385 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3b054693-7080-4542-b4c1-9c72a267824c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:56.882801 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3b054693-7080-4542-b4c1-9c72a267824c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:57.014422 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3b054693-7080-4542-b4c1-9c72a267824c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:57.022297 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3b054693-7080-4542-b4c1-9c72a267824c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.152895 Aug 05 02:25:57.022897 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 362/726] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:56 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:58.044760 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-36bc6ab0-0e6f-4cd7-8047-7a5422ea9b1d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:58.045374 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-36bc6ab0-0e6f-4cd7-8047-7a5422ea9b1d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:58.051734 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36bc6ab0-0e6f-4cd7-8047-7a5422ea9b1d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:58.052211 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36bc6ab0-0e6f-4cd7-8047-7a5422ea9b1d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:58.052685 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36bc6ab0-0e6f-4cd7-8047-7a5422ea9b1d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:58.053383 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36bc6ab0-0e6f-4cd7-8047-7a5422ea9b1d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:58.053816 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36bc6ab0-0e6f-4cd7-8047-7a5422ea9b1d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:58.054239 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-36bc6ab0-0e6f-4cd7-8047-7a5422ea9b1d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:58.187582 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-36bc6ab0-0e6f-4cd7-8047-7a5422ea9b1d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:58.195556 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-36bc6ab0-0e6f-4cd7-8047-7a5422ea9b1d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.155000 Aug 05 02:25:58.196116 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 365/727] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:58 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:25:59.216938 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8517d696-60f7-433f-ae38-1512d225c77c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:25:59.217536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8517d696-60f7-433f-ae38-1512d225c77c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:25:59.223788 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8517d696-60f7-433f-ae38-1512d225c77c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:59.224265 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8517d696-60f7-433f-ae38-1512d225c77c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:59.224727 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8517d696-60f7-433f-ae38-1512d225c77c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:59.225407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8517d696-60f7-433f-ae38-1512d225c77c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:25:59.225854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8517d696-60f7-433f-ae38-1512d225c77c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:25:59.226287 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8517d696-60f7-433f-ae38-1512d225c77c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:25:59.357754 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8517d696-60f7-433f-ae38-1512d225c77c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:25:59.365494 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8517d696-60f7-433f-ae38-1512d225c77c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.152760 Aug 05 02:25:59.366047 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 363/728] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:25:59 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:00.387599 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-de1b6697-672f-4904-8d12-800aeb8c6d7c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:00.388159 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-de1b6697-672f-4904-8d12-800aeb8c6d7c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:00.394907 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de1b6697-672f-4904-8d12-800aeb8c6d7c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:00.395383 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de1b6697-672f-4904-8d12-800aeb8c6d7c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:00.395812 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de1b6697-672f-4904-8d12-800aeb8c6d7c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:00.396526 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de1b6697-672f-4904-8d12-800aeb8c6d7c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:00.396976 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de1b6697-672f-4904-8d12-800aeb8c6d7c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:00.397398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de1b6697-672f-4904-8d12-800aeb8c6d7c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:00.530578 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-de1b6697-672f-4904-8d12-800aeb8c6d7c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:00.534358 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:00.540703 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-de1b6697-672f-4904-8d12-800aeb8c6d7c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.157703 Aug 05 02:26:00.541282 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 366/729] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:00 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:00.816540 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-00132950-5b91-499f-824c-e3170fd97466 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:00.817041 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-00132950-5b91-499f-824c-e3170fd97466 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:00.823477 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00132950-5b91-499f-824c-e3170fd97466 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:00.823954 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00132950-5b91-499f-824c-e3170fd97466 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:00.824422 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00132950-5b91-499f-824c-e3170fd97466 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:00.825117 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00132950-5b91-499f-824c-e3170fd97466 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:00.825568 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00132950-5b91-499f-824c-e3170fd97466 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:00.825989 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00132950-5b91-499f-824c-e3170fd97466 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:00.950869 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-00132950-5b91-499f-824c-e3170fd97466 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lazy-loading 'services' on Instance uuid d325dc2e-780c-41fe-bdad-ac41805f3534 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:26:01.064263 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-00132950-5b91-499f-824c-e3170fd97466 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/os-volume_attachments/e5d561a2-5177-4cc1-8784-be0133c81b0f" status: 202 len: 0 microversion: 2.1 time: 0.354846 Aug 05 02:26:01.065040 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 364/730] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Aug 5 02:26:00 2022] DELETE /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/os-volume_attachments/e5d561a2-5177-4cc1-8784-be0133c81b0f => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:26:01.563304 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a5c7c4c9-2c07-4cc7-973b-883b4bcc88b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:01.563912 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a5c7c4c9-2c07-4cc7-973b-883b4bcc88b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:01.571449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5c7c4c9-2c07-4cc7-973b-883b4bcc88b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:01.571933 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5c7c4c9-2c07-4cc7-973b-883b4bcc88b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:01.572399 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5c7c4c9-2c07-4cc7-973b-883b4bcc88b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:01.573788 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5c7c4c9-2c07-4cc7-973b-883b4bcc88b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:01.574244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5c7c4c9-2c07-4cc7-973b-883b4bcc88b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:01.574676 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a5c7c4c9-2c07-4cc7-973b-883b4bcc88b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:01.706481 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a5c7c4c9-2c07-4cc7-973b-883b4bcc88b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:01.715551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a5c7c4c9-2c07-4cc7-973b-883b4bcc88b9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.156049 Aug 05 02:26:01.716124 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 367/731] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:01 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:02.737215 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6db052f4-479e-4c8c-b04c-0823c3e9aaa9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:02.737900 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6db052f4-479e-4c8c-b04c-0823c3e9aaa9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:02.745277 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6db052f4-479e-4c8c-b04c-0823c3e9aaa9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:02.745763 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6db052f4-479e-4c8c-b04c-0823c3e9aaa9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:02.746186 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6db052f4-479e-4c8c-b04c-0823c3e9aaa9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:02.746858 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6db052f4-479e-4c8c-b04c-0823c3e9aaa9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:02.747300 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6db052f4-479e-4c8c-b04c-0823c3e9aaa9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:02.747712 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6db052f4-479e-4c8c-b04c-0823c3e9aaa9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:02.877066 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6db052f4-479e-4c8c-b04c-0823c3e9aaa9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:02.884936 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6db052f4-479e-4c8c-b04c-0823c3e9aaa9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.151882 Aug 05 02:26:02.885516 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 365/732] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:02 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:03.245052 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dce967b0-f4c7-4812-9d73-67c269b5858f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:03.251566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dce967b0-f4c7-4812-9d73-67c269b5858f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:03.252056 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dce967b0-f4c7-4812-9d73-67c269b5858f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:03.252536 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dce967b0-f4c7-4812-9d73-67c269b5858f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:03.277834 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dce967b0-f4c7-4812-9d73-67c269b5858f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Going to try to stop instance {{(pid=117920) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 05 02:26:03.319171 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dce967b0-f4c7-4812-9d73-67c269b5858f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "POST /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/action" status: 202 len: 0 microversion: 2.1 time: 0.077947 Aug 05 02:26:03.319828 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 368/733] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Aug 5 02:26:03 2022] POST /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:26:03.328344 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b35568bb-5b68-4670-a761-46e76806338d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:03.328957 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b35568bb-5b68-4670-a761-46e76806338d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:03.335155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b35568bb-5b68-4670-a761-46e76806338d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:03.335624 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b35568bb-5b68-4670-a761-46e76806338d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:03.336047 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b35568bb-5b68-4670-a761-46e76806338d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:03.336756 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b35568bb-5b68-4670-a761-46e76806338d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:03.337201 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b35568bb-5b68-4670-a761-46e76806338d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:03.337615 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b35568bb-5b68-4670-a761-46e76806338d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:03.475660 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b35568bb-5b68-4670-a761-46e76806338d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:03.484032 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b35568bb-5b68-4670-a761-46e76806338d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1675 microversion: 2.1 time: 0.159479 Aug 05 02:26:03.484651 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 366/734] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:03 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:03.906852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a6eceaff-9369-42f7-8f18-241f1d3ecf6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:03.907576 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a6eceaff-9369-42f7-8f18-241f1d3ecf6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:03.909562 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=31 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:03.914928 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6eceaff-9369-42f7-8f18-241f1d3ecf6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:03.915402 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6eceaff-9369-42f7-8f18-241f1d3ecf6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:03.915833 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6eceaff-9369-42f7-8f18-241f1d3ecf6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:03.917383 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6eceaff-9369-42f7-8f18-241f1d3ecf6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:03.917547 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6eceaff-9369-42f7-8f18-241f1d3ecf6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:03.917972 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6eceaff-9369-42f7-8f18-241f1d3ecf6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:04.046100 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a6eceaff-9369-42f7-8f18-241f1d3ecf6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:04.053962 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a6eceaff-9369-42f7-8f18-241f1d3ecf6f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.151298 Aug 05 02:26:04.054515 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 369/735] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:03 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:04.506156 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c81f6f8d-1477-496f-8da8-b309608effd1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:04.506770 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c81f6f8d-1477-496f-8da8-b309608effd1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:04.513611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c81f6f8d-1477-496f-8da8-b309608effd1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:04.514093 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c81f6f8d-1477-496f-8da8-b309608effd1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:04.514526 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c81f6f8d-1477-496f-8da8-b309608effd1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:04.515212 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c81f6f8d-1477-496f-8da8-b309608effd1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:04.515664 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c81f6f8d-1477-496f-8da8-b309608effd1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:04.516087 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c81f6f8d-1477-496f-8da8-b309608effd1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:04.642820 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c81f6f8d-1477-496f-8da8-b309608effd1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:04.646298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:04.651394 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c81f6f8d-1477-496f-8da8-b309608effd1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1675 microversion: 2.1 time: 0.148908 Aug 05 02:26:04.651957 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 367/736] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:04 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:05.075106 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-94fc2269-0cfb-48aa-a1c3-bfdf1bcdf98d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:05.075746 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-94fc2269-0cfb-48aa-a1c3-bfdf1bcdf98d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:05.082075 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94fc2269-0cfb-48aa-a1c3-bfdf1bcdf98d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:05.082546 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94fc2269-0cfb-48aa-a1c3-bfdf1bcdf98d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:05.082975 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94fc2269-0cfb-48aa-a1c3-bfdf1bcdf98d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:05.083701 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94fc2269-0cfb-48aa-a1c3-bfdf1bcdf98d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:05.084100 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94fc2269-0cfb-48aa-a1c3-bfdf1bcdf98d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:05.084544 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-94fc2269-0cfb-48aa-a1c3-bfdf1bcdf98d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:05.213613 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-94fc2269-0cfb-48aa-a1c3-bfdf1bcdf98d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:05.221644 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-94fc2269-0cfb-48aa-a1c3-bfdf1bcdf98d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.150564 Aug 05 02:26:05.222201 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 370/737] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:05 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:05.672865 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f722716a-a807-47bc-9e81-fbf90e95f397 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:05.673497 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f722716a-a807-47bc-9e81-fbf90e95f397 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:05.679999 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f722716a-a807-47bc-9e81-fbf90e95f397 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:05.680517 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f722716a-a807-47bc-9e81-fbf90e95f397 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:05.680947 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f722716a-a807-47bc-9e81-fbf90e95f397 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:05.681622 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f722716a-a807-47bc-9e81-fbf90e95f397 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:05.682106 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f722716a-a807-47bc-9e81-fbf90e95f397 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:05.682525 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f722716a-a807-47bc-9e81-fbf90e95f397 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:05.820023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f722716a-a807-47bc-9e81-fbf90e95f397 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:05.828129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f722716a-a807-47bc-9e81-fbf90e95f397 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1675 microversion: 2.1 time: 0.159734 Aug 05 02:26:05.828854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 368/738] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:05 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:06.242934 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-808f8383-23b7-48d8-84b1-38d81f66567a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:06.243471 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-808f8383-23b7-48d8-84b1-38d81f66567a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:06.250474 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-808f8383-23b7-48d8-84b1-38d81f66567a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:06.250948 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-808f8383-23b7-48d8-84b1-38d81f66567a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:06.251399 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-808f8383-23b7-48d8-84b1-38d81f66567a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:06.252084 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-808f8383-23b7-48d8-84b1-38d81f66567a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:06.252611 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-808f8383-23b7-48d8-84b1-38d81f66567a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:06.253028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-808f8383-23b7-48d8-84b1-38d81f66567a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:06.382663 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-808f8383-23b7-48d8-84b1-38d81f66567a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:06.391199 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-808f8383-23b7-48d8-84b1-38d81f66567a tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.152143 Aug 05 02:26:06.391763 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 371/739] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:06 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:06.849727 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e2875ddf-fbce-496c-8acf-ecd082ed63b5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:06.850329 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e2875ddf-fbce-496c-8acf-ecd082ed63b5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:06.856760 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e2875ddf-fbce-496c-8acf-ecd082ed63b5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:06.857237 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e2875ddf-fbce-496c-8acf-ecd082ed63b5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:06.857664 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e2875ddf-fbce-496c-8acf-ecd082ed63b5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:06.858344 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e2875ddf-fbce-496c-8acf-ecd082ed63b5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:06.858793 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e2875ddf-fbce-496c-8acf-ecd082ed63b5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:06.859214 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e2875ddf-fbce-496c-8acf-ecd082ed63b5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:06.989383 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e2875ddf-fbce-496c-8acf-ecd082ed63b5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:06.997697 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e2875ddf-fbce-496c-8acf-ecd082ed63b5 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1675 microversion: 2.1 time: 0.151919 Aug 05 02:26:06.998268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 369/740] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:06 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:07.412091 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d0a9b0e4-cd8d-4fa4-8f53-056919359259 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:07.412722 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d0a9b0e4-cd8d-4fa4-8f53-056919359259 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:07.420016 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0a9b0e4-cd8d-4fa4-8f53-056919359259 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:07.420527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0a9b0e4-cd8d-4fa4-8f53-056919359259 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:07.420961 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0a9b0e4-cd8d-4fa4-8f53-056919359259 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:07.421649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0a9b0e4-cd8d-4fa4-8f53-056919359259 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:07.422101 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0a9b0e4-cd8d-4fa4-8f53-056919359259 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:07.422526 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0a9b0e4-cd8d-4fa4-8f53-056919359259 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:07.555608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d0a9b0e4-cd8d-4fa4-8f53-056919359259 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:07.565207 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d0a9b0e4-cd8d-4fa4-8f53-056919359259 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1735 microversion: 2.1 time: 0.156842 Aug 05 02:26:07.565782 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 372/741] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:07 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:08.018467 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9549bb99-3384-4c9b-863b-2f8a729f56cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:08.019066 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9549bb99-3384-4c9b-863b-2f8a729f56cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:08.025376 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9549bb99-3384-4c9b-863b-2f8a729f56cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:08.026504 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9549bb99-3384-4c9b-863b-2f8a729f56cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:08.026932 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9549bb99-3384-4c9b-863b-2f8a729f56cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:08.027610 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9549bb99-3384-4c9b-863b-2f8a729f56cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:08.028058 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9549bb99-3384-4c9b-863b-2f8a729f56cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:08.028506 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9549bb99-3384-4c9b-863b-2f8a729f56cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:08.158351 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9549bb99-3384-4c9b-863b-2f8a729f56cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:08.165807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9549bb99-3384-4c9b-863b-2f8a729f56cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1675 microversion: 2.1 time: 0.151135 Aug 05 02:26:08.166789 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 370/742] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:08 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:08.586331 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dcbf5d59-d616-4261-8601-58d34852e262 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:08.586929 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dcbf5d59-d616-4261-8601-58d34852e262 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:08.593608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcbf5d59-d616-4261-8601-58d34852e262 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:08.594086 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcbf5d59-d616-4261-8601-58d34852e262 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:08.594521 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcbf5d59-d616-4261-8601-58d34852e262 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:08.595227 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcbf5d59-d616-4261-8601-58d34852e262 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:08.595681 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcbf5d59-d616-4261-8601-58d34852e262 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:08.596102 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dcbf5d59-d616-4261-8601-58d34852e262 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:08.727010 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dcbf5d59-d616-4261-8601-58d34852e262 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:08.735296 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dcbf5d59-d616-4261-8601-58d34852e262 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1715 microversion: 2.1 time: 0.152792 Aug 05 02:26:08.735879 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 373/743] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:08 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:08.795996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-86fe0a71-1d35-43d8-9ae6-224d1b17dba1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:08.796522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-86fe0a71-1d35-43d8-9ae6-224d1b17dba1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:08.798328 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=34 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:08.803428 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86fe0a71-1d35-43d8-9ae6-224d1b17dba1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:08.803929 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86fe0a71-1d35-43d8-9ae6-224d1b17dba1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:08.804392 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86fe0a71-1d35-43d8-9ae6-224d1b17dba1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:08.805071 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86fe0a71-1d35-43d8-9ae6-224d1b17dba1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:08.805524 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86fe0a71-1d35-43d8-9ae6-224d1b17dba1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:08.805974 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86fe0a71-1d35-43d8-9ae6-224d1b17dba1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:08.887201 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-86fe0a71-1d35-43d8-9ae6-224d1b17dba1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] HTTP exception thrown: Cannot 'detach_volume' instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 while it is in vm_state rescued Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-86fe0a71-1d35-43d8-9ae6-224d1b17dba1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Request method failure captured: Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-volume_attachments/f9048f0f-0033-41ff-aa66-8f255f6704ff HTTP/1.1 Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5uCxqFMV4xjjNEicbwn-Almmx4gjc1pUb71A8FIyVx8kunNx-w_ca81bXVAOmrqecVOU6tQQ9CUuL6-vxI4zUOkgPqmvK3bhOYSnsCfmASkY-Ed2wRrlD38yMwuEjNowSpZxw4W5LwuL9n11WU2krtppQjp6wb1pPplKkDftUslgY Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: 00eaaf2e12844123996e26c1827d80b2 Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2105783776 Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:26:08.888823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:26:08.890233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/00eaaf2e12844123996e26c1827d80b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_00eaaf2e12844123996e26c1827d80b2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/00eaaf2e12844123996e26c1827d80b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/00eaaf2e12844123996e26c1827d80b2"}]}] Aug 05 02:26:08.890233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2105783776 Aug 05 02:26:08.890233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 00eaaf2e12844123996e26c1827d80b2 Aug 05 02:26:08.890233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2105783776 Aug 05 02:26:08.890233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-ServerRescueNegativeTestJSON-2105783776-project Aug 05 02:26:08.890233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:26:08.890233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:26:08.890233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 5bf84408a3984972a5bb68a3117c0501 Aug 05 02:26:08.890233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2105783776-project Aug 05 02:26:08.890233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:26:08.890233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Cannot 'detach_volume' instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 while it is in vm_state rescued Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'server_id': '56c37a85-a2b7-4dec-983c-5b65e70c3aa0', 'id': 'f9048f0f-0033-41ff-aa66-8f255f6704ff'} Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:26:08.890902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:26:08.892268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 05 02:26:08.892268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 05 02:26:08.892268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 05 02:26:08.892268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 05 02:26:08.892268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 while it is in vm_state rescued Aug 05 02:26:08.892268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:26:08.892268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:26:08.892268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:26:08.892268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:26:08.892268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:26:08.892268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:26:08.892268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:26:08.892268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:26:08.892268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 while it is in vm_state rescued Aug 05 02:26:08.892268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:26:08.892268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-86fe0a71-1d35-43d8-9ae6-224d1b17dba1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Returning 409 to user: Cannot 'detach_volume' instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 while it is in vm_state rescued {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:26:08.893471 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-86fe0a71-1d35-43d8-9ae6-224d1b17dba1 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "DELETE /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-volume_attachments/f9048f0f-0033-41ff-aa66-8f255f6704ff" status: 409 len: 152 microversion: 2.1 time: 0.098320 Aug 05 02:26:08.893471 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 371/744] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Aug 5 02:26:08 2022] DELETE /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-volume_attachments/f9048f0f-0033-41ff-aa66-8f255f6704ff => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 05 02:26:08.899033 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-241d8bf0-61f9-4ea4-b1e3-d95479f04d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:08.899596 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-241d8bf0-61f9-4ea4-b1e3-d95479f04d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:08.906016 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-241d8bf0-61f9-4ea4-b1e3-d95479f04d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:08.906496 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-241d8bf0-61f9-4ea4-b1e3-d95479f04d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:08.906930 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-241d8bf0-61f9-4ea4-b1e3-d95479f04d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:08.907620 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-241d8bf0-61f9-4ea4-b1e3-d95479f04d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:08.908072 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-241d8bf0-61f9-4ea4-b1e3-d95479f04d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:08.908534 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-241d8bf0-61f9-4ea4-b1e3-d95479f04d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:08.974419 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-241d8bf0-61f9-4ea4-b1e3-d95479f04d8c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "POST /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/action" status: 202 len: 0 microversion: 2.1 time: 0.079055 Aug 05 02:26:08.975074 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 374/745] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Aug 5 02:26:08 2022] POST /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:26:08.983289 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6792a0c4-0253-4595-8f96-14938d340806 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:08.983892 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6792a0c4-0253-4595-8f96-14938d340806 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:08.990314 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6792a0c4-0253-4595-8f96-14938d340806 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:08.990966 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6792a0c4-0253-4595-8f96-14938d340806 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:08.991428 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6792a0c4-0253-4595-8f96-14938d340806 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:08.992277 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6792a0c4-0253-4595-8f96-14938d340806 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:08.992763 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6792a0c4-0253-4595-8f96-14938d340806 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:08.993186 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6792a0c4-0253-4595-8f96-14938d340806 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:09.188075 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bff33606-a042-4b62-866a-c60b5f22ab02 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:09.188792 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bff33606-a042-4b62-866a-c60b5f22ab02 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:09.194858 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bff33606-a042-4b62-866a-c60b5f22ab02 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:09.195339 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bff33606-a042-4b62-866a-c60b5f22ab02 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:09.195774 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bff33606-a042-4b62-866a-c60b5f22ab02 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:09.196489 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bff33606-a042-4b62-866a-c60b5f22ab02 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:09.196946 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bff33606-a042-4b62-866a-c60b5f22ab02 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:09.197949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bff33606-a042-4b62-866a-c60b5f22ab02 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:09.201299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6792a0c4-0253-4595-8f96-14938d340806 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:09.210577 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6792a0c4-0253-4595-8f96-14938d340806 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1723 microversion: 2.1 time: 0.231258 Aug 05 02:26:09.211528 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 372/746] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:08 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:09.329937 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bff33606-a042-4b62-866a-c60b5f22ab02 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:09.337523 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bff33606-a042-4b62-866a-c60b5f22ab02 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1675 microversion: 2.1 time: 0.153684 Aug 05 02:26:09.338189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 375/747] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:09 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:10.231180 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7b74ec58-54c0-4318-9d5d-a783734ee6d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:10.231780 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7b74ec58-54c0-4318-9d5d-a783734ee6d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:10.238183 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7b74ec58-54c0-4318-9d5d-a783734ee6d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:10.238604 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7b74ec58-54c0-4318-9d5d-a783734ee6d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:10.239031 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7b74ec58-54c0-4318-9d5d-a783734ee6d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:10.239701 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7b74ec58-54c0-4318-9d5d-a783734ee6d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:10.240141 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7b74ec58-54c0-4318-9d5d-a783734ee6d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:10.240579 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7b74ec58-54c0-4318-9d5d-a783734ee6d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:10.358496 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d6d94a4d-cedc-4657-834f-915f0ac6d5bf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:10.359274 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d6d94a4d-cedc-4657-834f-915f0ac6d5bf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:10.365690 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6d94a4d-cedc-4657-834f-915f0ac6d5bf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:10.366174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6d94a4d-cedc-4657-834f-915f0ac6d5bf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:10.366603 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6d94a4d-cedc-4657-834f-915f0ac6d5bf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:10.367289 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6d94a4d-cedc-4657-834f-915f0ac6d5bf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:10.367737 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6d94a4d-cedc-4657-834f-915f0ac6d5bf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:10.368157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6d94a4d-cedc-4657-834f-915f0ac6d5bf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:10.372761 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7b74ec58-54c0-4318-9d5d-a783734ee6d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:10.380772 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7b74ec58-54c0-4318-9d5d-a783734ee6d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1723 microversion: 2.1 time: 0.153374 Aug 05 02:26:10.381421 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 373/748] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:10 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:10.500170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d6d94a4d-cedc-4657-834f-915f0ac6d5bf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:10.507500 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d6d94a4d-cedc-4657-834f-915f0ac6d5bf tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1675 microversion: 2.1 time: 0.152842 Aug 05 02:26:10.508055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 376/749] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:10 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:26:11.403355 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-51346c58-3ebf-4fea-a963-ca15f039688d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:11.403997 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-51346c58-3ebf-4fea-a963-ca15f039688d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:11.410378 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51346c58-3ebf-4fea-a963-ca15f039688d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:11.410838 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51346c58-3ebf-4fea-a963-ca15f039688d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:11.411271 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51346c58-3ebf-4fea-a963-ca15f039688d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:11.411946 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51346c58-3ebf-4fea-a963-ca15f039688d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:11.412421 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51346c58-3ebf-4fea-a963-ca15f039688d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:11.412842 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51346c58-3ebf-4fea-a963-ca15f039688d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:11.529611 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3bfb1f58-1170-4b55-a070-13ba45e3ade9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:11.530304 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3bfb1f58-1170-4b55-a070-13ba45e3ade9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:11.536671 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bfb1f58-1170-4b55-a070-13ba45e3ade9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:11.537237 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bfb1f58-1170-4b55-a070-13ba45e3ade9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:11.537733 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bfb1f58-1170-4b55-a070-13ba45e3ade9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:11.538538 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bfb1f58-1170-4b55-a070-13ba45e3ade9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:11.538954 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bfb1f58-1170-4b55-a070-13ba45e3ade9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:11.539370 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3bfb1f58-1170-4b55-a070-13ba45e3ade9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:11.541739 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-51346c58-3ebf-4fea-a963-ca15f039688d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:11.550044 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-51346c58-3ebf-4fea-a963-ca15f039688d tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1723 microversion: 2.1 time: 0.151151 Aug 05 02:26:11.550593 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 374/750] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:11 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:11.669398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3bfb1f58-1170-4b55-a070-13ba45e3ade9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:11.676802 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3bfb1f58-1170-4b55-a070-13ba45e3ade9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1675 microversion: 2.1 time: 0.151703 Aug 05 02:26:11.677385 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 377/751] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:11 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:26:12.571601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-681aaacd-d1b8-4704-98f1-a12c99461559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:12.573076 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-681aaacd-d1b8-4704-98f1-a12c99461559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:12.579380 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-681aaacd-d1b8-4704-98f1-a12c99461559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:12.579860 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-681aaacd-d1b8-4704-98f1-a12c99461559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:12.580295 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-681aaacd-d1b8-4704-98f1-a12c99461559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:12.580997 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-681aaacd-d1b8-4704-98f1-a12c99461559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:12.581450 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-681aaacd-d1b8-4704-98f1-a12c99461559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:12.581869 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-681aaacd-d1b8-4704-98f1-a12c99461559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:12.698648 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1be90438-aa99-47c3-8830-37f18f41276f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:12.699879 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1be90438-aa99-47c3-8830-37f18f41276f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:12.706205 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1be90438-aa99-47c3-8830-37f18f41276f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:12.706694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1be90438-aa99-47c3-8830-37f18f41276f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:12.707124 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1be90438-aa99-47c3-8830-37f18f41276f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:12.707818 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1be90438-aa99-47c3-8830-37f18f41276f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:12.708269 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1be90438-aa99-47c3-8830-37f18f41276f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:12.708716 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1be90438-aa99-47c3-8830-37f18f41276f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:12.712884 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-681aaacd-d1b8-4704-98f1-a12c99461559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:12.721893 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-681aaacd-d1b8-4704-98f1-a12c99461559 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1723 microversion: 2.1 time: 0.154140 Aug 05 02:26:12.722558 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 375/752] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:12 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:12.841841 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1be90438-aa99-47c3-8830-37f18f41276f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:12.849317 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1be90438-aa99-47c3-8830-37f18f41276f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1675 microversion: 2.1 time: 0.155003 Aug 05 02:26:12.849871 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 378/753] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:12 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:26:13.743063 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ebcb96ab-2404-4ff5-a028-dae14b67f89e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:13.743693 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ebcb96ab-2404-4ff5-a028-dae14b67f89e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:13.750102 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ebcb96ab-2404-4ff5-a028-dae14b67f89e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:13.750574 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ebcb96ab-2404-4ff5-a028-dae14b67f89e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:13.751002 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ebcb96ab-2404-4ff5-a028-dae14b67f89e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:13.751678 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ebcb96ab-2404-4ff5-a028-dae14b67f89e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:13.752126 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ebcb96ab-2404-4ff5-a028-dae14b67f89e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:13.752567 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ebcb96ab-2404-4ff5-a028-dae14b67f89e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:13.870256 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8501ef3d-879b-485a-b577-9abe401c6e85 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:13.871306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8501ef3d-879b-485a-b577-9abe401c6e85 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:13.877472 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8501ef3d-879b-485a-b577-9abe401c6e85 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:13.877947 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8501ef3d-879b-485a-b577-9abe401c6e85 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:13.878379 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8501ef3d-879b-485a-b577-9abe401c6e85 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:13.879146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8501ef3d-879b-485a-b577-9abe401c6e85 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:13.879595 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8501ef3d-879b-485a-b577-9abe401c6e85 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:13.880012 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8501ef3d-879b-485a-b577-9abe401c6e85 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:13.889790 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ebcb96ab-2404-4ff5-a028-dae14b67f89e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:13.897916 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ebcb96ab-2404-4ff5-a028-dae14b67f89e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1729 microversion: 2.1 time: 0.158581 Aug 05 02:26:13.898481 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 376/754] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:13 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:13.918651 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-74178183-f9d6-4726-bc3f-2fb68101ccb5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:13.919142 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-74178183-f9d6-4726-bc3f-2fb68101ccb5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:13.925147 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-74178183-f9d6-4726-bc3f-2fb68101ccb5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:13.925630 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-74178183-f9d6-4726-bc3f-2fb68101ccb5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:13.926059 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-74178183-f9d6-4726-bc3f-2fb68101ccb5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:13.926747 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-74178183-f9d6-4726-bc3f-2fb68101ccb5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:13.927200 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-74178183-f9d6-4726-bc3f-2fb68101ccb5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:13.927614 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-74178183-f9d6-4726-bc3f-2fb68101ccb5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:14.006926 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-74178183-f9d6-4726-bc3f-2fb68101ccb5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092076 Aug 05 02:26:14.007525 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 377/755] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Aug 5 02:26:13 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:26:14.015434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8501ef3d-879b-485a-b577-9abe401c6e85 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:14.023251 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8501ef3d-879b-485a-b577-9abe401c6e85 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1652 microversion: 2.1 time: 0.157211 Aug 05 02:26:14.023817 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 379/756] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:13 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1652 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:26:14.044552 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bb5a2d3f-e119-4e73-a559-0685b6d598c6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:14.050482 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb5a2d3f-e119-4e73-a559-0685b6d598c6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:14.050958 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb5a2d3f-e119-4e73-a559-0685b6d598c6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:14.051380 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb5a2d3f-e119-4e73-a559-0685b6d598c6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:14.112661 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bb5a2d3f-e119-4e73-a559-0685b6d598c6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Going to try to start instance {{(pid=117921) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 05 02:26:14.156594 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bb5a2d3f-e119-4e73-a559-0685b6d598c6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "POST /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/action" status: 202 len: 0 microversion: 2.1 time: 0.116096 Aug 05 02:26:14.157197 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 378/757] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Aug 5 02:26:14 2022] POST /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:26:14.165858 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b194bf3b-58f0-4000-a217-bad480f7f33e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:14.166469 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b194bf3b-58f0-4000-a217-bad480f7f33e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:14.173901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b194bf3b-58f0-4000-a217-bad480f7f33e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:14.174494 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b194bf3b-58f0-4000-a217-bad480f7f33e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:14.174985 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b194bf3b-58f0-4000-a217-bad480f7f33e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:14.175944 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b194bf3b-58f0-4000-a217-bad480f7f33e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:14.176535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b194bf3b-58f0-4000-a217-bad480f7f33e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:14.176960 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b194bf3b-58f0-4000-a217-bad480f7f33e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:14.427357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b194bf3b-58f0-4000-a217-bad480f7f33e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:14.435468 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b194bf3b-58f0-4000-a217-bad480f7f33e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1661 microversion: 2.1 time: 0.273496 Aug 05 02:26:14.436050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 380/758] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:14 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1661 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:15.300731 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-90b70266-32f7-4cee-83fc-adc368005c7b req-d9ccdb16-db83-4f7d-a48d-ec9c63c5e5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c37a85-a2b7-4dec-983c-5b65e70c3aa0", "tag": "025ccb86-82f0-4646-825e-bf471dd56047"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:15.311394 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-90b70266-32f7-4cee-83fc-adc368005c7b req-d9ccdb16-db83-4f7d-a48d-ec9c63c5e5a0 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:15.311976 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-90b70266-32f7-4cee-83fc-adc368005c7b req-d9ccdb16-db83-4f7d-a48d-ec9c63c5e5a0 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:15.312519 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-90b70266-32f7-4cee-83fc-adc368005c7b req-d9ccdb16-db83-4f7d-a48d-ec9c63c5e5a0 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:15.325112 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-90b70266-32f7-4cee-83fc-adc368005c7b req-d9ccdb16-db83-4f7d-a48d-ec9c63c5e5a0 service nova] Creating event network-changed:025ccb86-82f0-4646-825e-bf471dd56047 for instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 on hv-cinder-81558 Aug 05 02:26:15.330514 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-90b70266-32f7-4cee-83fc-adc368005c7b req-d9ccdb16-db83-4f7d-a48d-ec9c63c5e5a0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092024 Aug 05 02:26:15.331213 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 379/759] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:26:15.456557 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-93db0643-b003-4555-993d-d25fc6e6c7a9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:15.457167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-93db0643-b003-4555-993d-d25fc6e6c7a9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:15.463663 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93db0643-b003-4555-993d-d25fc6e6c7a9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:15.466607 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93db0643-b003-4555-993d-d25fc6e6c7a9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:15.466779 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93db0643-b003-4555-993d-d25fc6e6c7a9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:15.467500 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93db0643-b003-4555-993d-d25fc6e6c7a9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:15.467958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93db0643-b003-4555-993d-d25fc6e6c7a9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:15.468446 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93db0643-b003-4555-993d-d25fc6e6c7a9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:15.486688 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:15.600207 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-93db0643-b003-4555-993d-d25fc6e6c7a9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:15.607874 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-93db0643-b003-4555-993d-d25fc6e6c7a9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1665 microversion: 2.1 time: 0.155174 Aug 05 02:26:15.608460 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 381/760] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:15 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:17.346346 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-20d666f8-dced-4087-8dd2-b351b2989141 req-73dc65e6-b695-46ad-9f7f-c87cc8a33092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c37a85-a2b7-4dec-983c-5b65e70c3aa0", "tag": "025ccb86-82f0-4646-825e-bf471dd56047"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:17.356959 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-20d666f8-dced-4087-8dd2-b351b2989141 req-73dc65e6-b695-46ad-9f7f-c87cc8a33092 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:17.357423 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-20d666f8-dced-4087-8dd2-b351b2989141 req-73dc65e6-b695-46ad-9f7f-c87cc8a33092 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:17.357842 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-20d666f8-dced-4087-8dd2-b351b2989141 req-73dc65e6-b695-46ad-9f7f-c87cc8a33092 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:17.368372 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-20d666f8-dced-4087-8dd2-b351b2989141 req-73dc65e6-b695-46ad-9f7f-c87cc8a33092 service nova] Creating event network-changed:025ccb86-82f0-4646-825e-bf471dd56047 for instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 on hv-cinder-81558 Aug 05 02:26:17.373383 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-20d666f8-dced-4087-8dd2-b351b2989141 req-73dc65e6-b695-46ad-9f7f-c87cc8a33092 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031021 Aug 05 02:26:17.374167 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 380/761] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:26:17.874845 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4e9d2940-98f7-4787-8454-f52e4abfa4e0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:17.875401 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4e9d2940-98f7-4787-8454-f52e4abfa4e0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:17.881268 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e9d2940-98f7-4787-8454-f52e4abfa4e0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:17.881743 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e9d2940-98f7-4787-8454-f52e4abfa4e0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:17.882172 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e9d2940-98f7-4787-8454-f52e4abfa4e0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:17.882902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e9d2940-98f7-4787-8454-f52e4abfa4e0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:17.883295 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e9d2940-98f7-4787-8454-f52e4abfa4e0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:17.883708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4e9d2940-98f7-4787-8454-f52e4abfa4e0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:17.907307 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4e9d2940-98f7-4787-8454-f52e4abfa4e0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c/ips" status: 200 len: 150 microversion: 2.1 time: 0.144092 Aug 05 02:26:17.907856 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 382/762] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Aug 5 02:26:17 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c/ips => generated 150 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:26:17.921022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3cb74e4a-7076-4d75-8cd9-1a20d07923fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf3f2c65-3406-4b9b-803e-f9095c410b4f"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:17.923378 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3cb74e4a-7076-4d75-8cd9-1a20d07923fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:17.929398 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3cb74e4a-7076-4d75-8cd9-1a20d07923fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:17.929870 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3cb74e4a-7076-4d75-8cd9-1a20d07923fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:17.930303 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3cb74e4a-7076-4d75-8cd9-1a20d07923fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:17.930980 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3cb74e4a-7076-4d75-8cd9-1a20d07923fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:17.931427 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3cb74e4a-7076-4d75-8cd9-1a20d07923fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:17.931840 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3cb74e4a-7076-4d75-8cd9-1a20d07923fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:18.011572 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-3cb74e4a-7076-4d75-8cd9-1a20d07923fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] HTTP exception thrown: Invalid volume: volume bf3f2c65-3406-4b9b-803e-f9095c410b4f is already attached to instances: 1a387642-9e46-4a64-8017-43786f426b70 Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3cb74e4a-7076-4d75-8cd9-1a20d07923fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Request method failure captured: Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: POST /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c/os-volume_attachments HTTP/1.1 Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 74 Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5pSyPEti3j-9gLBxlgA1L_GuWB6iJvenWVBmfr31mrg4vu4HTgr4mx0c2q3ZmjrMdxdtLzCg8wRia849DSEc7AfP2crmxulEg45Cq3I2oORZ75mc5ksg7ZmJKJ4cA2qZbyq7NZRhJeqx1H2xWUpibdSGnuQ0avaMqjO9VbCjnpzbo Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:26:18.013589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:26:18.015182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ad6a220b99d94a648150476bf0a01e50", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}] Aug 05 02:26:18.015182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:26:18.015182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:26:18.015182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:26:18.015182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:26:18.015182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:26:18.015182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:26:18.015182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 600f51be8202427fb3691db566ed2ff2 Aug 05 02:26:18.015182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:26:18.015182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Aug 05 02:26:18.015182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {"volumeAttachment": {"volumeId": "bf3f2c65-3406-4b9b-803e-f9095c410b4f"}} Aug 05 02:26:18.015182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Invalid volume: volume bf3f2c65-3406-4b9b-803e-f9095c410b4f is already attached to instances: 1a387642-9e46-4a64-8017-43786f426b70 Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'server_id': '184f7bdb-49dd-4b9c-864d-e07bdb888d6c', 'body': {'volumeAttachment': {'volumeId': 'bf3f2c65-3406-4b9b-803e-f9095c410b4f'}}} Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bf3f2c65-3406-4b9b-803e-f9095c410b4f is already attached to instances: 1a387642-9e46-4a64-8017-43786f426b70 Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:26:18.016084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bf3f2c65-3406-4b9b-803e-f9095c410b4f is already attached to instances: 1a387642-9e46-4a64-8017-43786f426b70 Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:26:18.017499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:26:18.019014 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:26:18.019014 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:26:18.019014 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:26:18.019014 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bf3f2c65-3406-4b9b-803e-f9095c410b4f is already attached to instances: 1a387642-9e46-4a64-8017-43786f426b70 Aug 05 02:26:18.019014 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:26:18.019014 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3cb74e4a-7076-4d75-8cd9-1a20d07923fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Returning 400 to user: Invalid volume: volume bf3f2c65-3406-4b9b-803e-f9095c410b4f is already attached to instances: 1a387642-9e46-4a64-8017-43786f426b70 {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:26:18.019014 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3cb74e4a-7076-4d75-8cd9-1a20d07923fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "POST /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098748 Aug 05 02:26:18.019014 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 381/763] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Aug 5 02:26:17 2022] POST /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 02:26:18.024198 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a51368b2-eecb-446f-bf66-1f4b54a3e3ec tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:18.024729 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a51368b2-eecb-446f-bf66-1f4b54a3e3ec tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:18.031178 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a51368b2-eecb-446f-bf66-1f4b54a3e3ec tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:18.031654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a51368b2-eecb-446f-bf66-1f4b54a3e3ec tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:18.032087 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a51368b2-eecb-446f-bf66-1f4b54a3e3ec tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:18.032804 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a51368b2-eecb-446f-bf66-1f4b54a3e3ec tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:18.033259 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a51368b2-eecb-446f-bf66-1f4b54a3e3ec tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:18.033681 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a51368b2-eecb-446f-bf66-1f4b54a3e3ec tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:18.057821 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a51368b2-eecb-446f-bf66-1f4b54a3e3ec tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:26:18.133891 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a51368b2-eecb-446f-bf66-1f4b54a3e3ec tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "DELETE /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 204 len: 0 microversion: 2.1 time: 0.113039 Aug 05 02:26:18.134743 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 383/764] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:26:18 2022] DELETE /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:26:18.143667 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1702f6c8-ff27-46fa-96af-d9a6d68dcecc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:18.144277 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1702f6c8-ff27-46fa-96af-d9a6d68dcecc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:18.150889 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1702f6c8-ff27-46fa-96af-d9a6d68dcecc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:18.151935 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1702f6c8-ff27-46fa-96af-d9a6d68dcecc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:18.152404 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1702f6c8-ff27-46fa-96af-d9a6d68dcecc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:18.153099 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1702f6c8-ff27-46fa-96af-d9a6d68dcecc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:18.153554 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1702f6c8-ff27-46fa-96af-d9a6d68dcecc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:18.153981 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1702f6c8-ff27-46fa-96af-d9a6d68dcecc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:18.284230 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1702f6c8-ff27-46fa-96af-d9a6d68dcecc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:18.291605 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1702f6c8-ff27-46fa-96af-d9a6d68dcecc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1683 microversion: 2.1 time: 0.151685 Aug 05 02:26:18.292173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 382/765] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:18 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:19.312882 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-81667e89-67d5-4b66-a5d3-7fd6a950db7f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:19.313604 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-81667e89-67d5-4b66-a5d3-7fd6a950db7f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:19.319962 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81667e89-67d5-4b66-a5d3-7fd6a950db7f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:19.320475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81667e89-67d5-4b66-a5d3-7fd6a950db7f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:19.320911 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81667e89-67d5-4b66-a5d3-7fd6a950db7f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:19.321595 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81667e89-67d5-4b66-a5d3-7fd6a950db7f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:19.322049 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81667e89-67d5-4b66-a5d3-7fd6a950db7f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:19.322474 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-81667e89-67d5-4b66-a5d3-7fd6a950db7f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:19.453791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-81667e89-67d5-4b66-a5d3-7fd6a950db7f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:19.461197 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-81667e89-67d5-4b66-a5d3-7fd6a950db7f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1683 microversion: 2.1 time: 0.152558 Aug 05 02:26:19.461760 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 384/766] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:19 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:20.482797 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d6515867-e291-4bb1-8829-e3eca92c6315 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:20.483671 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d6515867-e291-4bb1-8829-e3eca92c6315 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:20.489579 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d6515867-e291-4bb1-8829-e3eca92c6315 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:20.490053 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d6515867-e291-4bb1-8829-e3eca92c6315 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:20.490483 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d6515867-e291-4bb1-8829-e3eca92c6315 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:20.491170 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d6515867-e291-4bb1-8829-e3eca92c6315 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:20.491621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d6515867-e291-4bb1-8829-e3eca92c6315 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:20.492038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d6515867-e291-4bb1-8829-e3eca92c6315 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:20.725273 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d6515867-e291-4bb1-8829-e3eca92c6315 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:20.733630 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d6515867-e291-4bb1-8829-e3eca92c6315 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1683 microversion: 2.1 time: 0.254829 Aug 05 02:26:20.734186 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 383/767] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:20 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1683 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:21.429360 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-4da7f94a-da40-4da0-aa6b-ffac5d742c74 req-5747a350-6907-49f7-870a-4533bab0a90a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184f7bdb-49dd-4b9c-864d-e07bdb888d6c", "name": "network-vif-deleted", "tag": "9106f29f-cfec-4c3a-9817-3041bd272f04"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:21.439250 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4da7f94a-da40-4da0-aa6b-ffac5d742c74 req-5747a350-6907-49f7-870a-4533bab0a90a service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:21.440003 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4da7f94a-da40-4da0-aa6b-ffac5d742c74 req-5747a350-6907-49f7-870a-4533bab0a90a service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:21.440454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4da7f94a-da40-4da0-aa6b-ffac5d742c74 req-5747a350-6907-49f7-870a-4533bab0a90a service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:21.452605 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-4da7f94a-da40-4da0-aa6b-ffac5d742c74 req-5747a350-6907-49f7-870a-4533bab0a90a service nova] Creating event network-vif-deleted:9106f29f-cfec-4c3a-9817-3041bd272f04 for instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c on hv-cinder-81558 Aug 05 02:26:21.458307 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-4da7f94a-da40-4da0-aa6b-ffac5d742c74 req-5747a350-6907-49f7-870a-4533bab0a90a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093652 Aug 05 02:26:21.458981 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 385/768] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:26:21.755137 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4ef3d9cc-6959-4719-afca-90a2be57d856 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:21.756360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4ef3d9cc-6959-4719-afca-90a2be57d856 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:21.763275 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef3d9cc-6959-4719-afca-90a2be57d856 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:21.763835 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef3d9cc-6959-4719-afca-90a2be57d856 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:21.764343 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef3d9cc-6959-4719-afca-90a2be57d856 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:21.765103 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef3d9cc-6959-4719-afca-90a2be57d856 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:21.766083 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef3d9cc-6959-4719-afca-90a2be57d856 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:21.766263 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef3d9cc-6959-4719-afca-90a2be57d856 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:21.799196 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef3d9cc-6959-4719-afca-90a2be57d856 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:21.799825 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef3d9cc-6959-4719-afca-90a2be57d856 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:21.800378 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4ef3d9cc-6959-4719-afca-90a2be57d856 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:21.800916 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-4ef3d9cc-6959-4719-afca-90a2be57d856 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lazy-loading 'fault' on Instance uuid 184f7bdb-49dd-4b9c-864d-e07bdb888d6c {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:26:21.860311 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4ef3d9cc-6959-4719-afca-90a2be57d856 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:21.864821 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:21.871939 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4ef3d9cc-6959-4719-afca-90a2be57d856 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 200 len: 1332 microversion: 2.1 time: 0.120658 Aug 05 02:26:21.874898 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 384/769] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:21 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 1332 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:22.896437 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2acee146-0b5a-470c-bfd5-9ab6a52b04ba tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:22.897130 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2acee146-0b5a-470c-bfd5-9ab6a52b04ba tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:22.904283 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2acee146-0b5a-470c-bfd5-9ab6a52b04ba tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:22.904784 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2acee146-0b5a-470c-bfd5-9ab6a52b04ba tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:22.905210 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2acee146-0b5a-470c-bfd5-9ab6a52b04ba tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:22.905907 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2acee146-0b5a-470c-bfd5-9ab6a52b04ba tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:22.906361 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2acee146-0b5a-470c-bfd5-9ab6a52b04ba tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:22.906780 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2acee146-0b5a-470c-bfd5-9ab6a52b04ba tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:22.920986 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-2acee146-0b5a-470c-bfd5-9ab6a52b04ba tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] HTTP exception thrown: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2acee146-0b5a-470c-bfd5-9ab6a52b04ba tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Request method failure captured: Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c HTTP/1.1 Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5pSyPEti3j-9gLBxlgA1L_GuWB6iJvenWVBmfr31mrg4vu4HTgr4mx0c2q3ZmjrMdxdtLzCg8wRia849DSEc7AfP2crmxulEg45Cq3I2oORZ75mc5ksg7ZmJKJ4cA2qZbyq7NZRhJeqx1H2xWUpibdSGnuQ0avaMqjO9VbCjnpzbo Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:26:22.922649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:26:22.924165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ad6a220b99d94a648150476bf0a01e50", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}] Aug 05 02:26:22.924165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:26:22.924165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:26:22.924165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:26:22.924165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:26:22.924165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:26:22.924165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:26:22.924165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 600f51be8202427fb3691db566ed2ff2 Aug 05 02:26:22.924165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:26:22.924165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:26:22.924165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. Aug 05 02:26:22.924165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '184f7bdb-49dd-4b9c-864d-e07bdb888d6c'} Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:26:22.925028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. Aug 05 02:26:22.926244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:26:22.927380 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2acee146-0b5a-470c-bfd5-9ab6a52b04ba tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Returning 404 to user: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:26:22.927380 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2acee146-0b5a-470c-bfd5-9ab6a52b04ba tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 404 len: 111 microversion: 2.1 time: 0.032469 Aug 05 02:26:22.927380 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 386/770] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:22 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:26:22.933917 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-574832a9-b0b9-48d0-b15e-10d4c244209d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '.version_select at 0x7fa65c584c10>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:22.958712 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-574832a9-b0b9-48d0-b15e-10d4c244209d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089784729" status: 202 len: 0 microversion: 2.1 time: 0.029276 Aug 05 02:26:22.959434 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 385/771] 10.222.0.15 () {58 vars in 1221 bytes} [Fri Aug 5 02:26:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089784729 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:26:23.597723 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-73012494-0a79-4e2f-aaef-fd860fe11404 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:23.598310 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-73012494-0a79-4e2f-aaef-fd860fe11404 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:23.605973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73012494-0a79-4e2f-aaef-fd860fe11404 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:23.606459 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73012494-0a79-4e2f-aaef-fd860fe11404 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:23.606888 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73012494-0a79-4e2f-aaef-fd860fe11404 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:23.607595 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73012494-0a79-4e2f-aaef-fd860fe11404 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:23.608044 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73012494-0a79-4e2f-aaef-fd860fe11404 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:23.608495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73012494-0a79-4e2f-aaef-fd860fe11404 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:23.733334 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-73012494-0a79-4e2f-aaef-fd860fe11404 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lazy-loading 'services' on Instance uuid 1a387642-9e46-4a64-8017-43786f426b70 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:26:23.844649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-73012494-0a79-4e2f-aaef-fd860fe11404 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70/os-volume_attachments/bf3f2c65-3406-4b9b-803e-f9095c410b4f" status: 202 len: 0 microversion: 2.1 time: 0.250709 Aug 05 02:26:23.845489 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 387/772] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Aug 5 02:26:23 2022] DELETE /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70/os-volume_attachments/bf3f2c65-3406-4b9b-803e-f9095c410b4f => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:26:23.854338 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-498c6a8b-7756-43c2-9975-b02b21bc2adb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:23.856600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-498c6a8b-7756-43c2-9975-b02b21bc2adb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:23.863051 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-498c6a8b-7756-43c2-9975-b02b21bc2adb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:23.863537 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-498c6a8b-7756-43c2-9975-b02b21bc2adb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:23.863969 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-498c6a8b-7756-43c2-9975-b02b21bc2adb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:23.864702 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-498c6a8b-7756-43c2-9975-b02b21bc2adb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:23.865155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-498c6a8b-7756-43c2-9975-b02b21bc2adb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:23.865580 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-498c6a8b-7756-43c2-9975-b02b21bc2adb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:23.897228 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-498c6a8b-7756-43c2-9975-b02b21bc2adb tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047310 Aug 05 02:26:23.897784 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 386/773] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:26:23 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:26:24.910761 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-17862f57-94ae-4273-96eb-032412ef2904 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:24.913131 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-17862f57-94ae-4273-96eb-032412ef2904 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:24.921444 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17862f57-94ae-4273-96eb-032412ef2904 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:24.922133 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17862f57-94ae-4273-96eb-032412ef2904 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:24.922576 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17862f57-94ae-4273-96eb-032412ef2904 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:24.923275 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17862f57-94ae-4273-96eb-032412ef2904 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:24.923881 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17862f57-94ae-4273-96eb-032412ef2904 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:24.924311 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-17862f57-94ae-4273-96eb-032412ef2904 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:24.957706 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-17862f57-94ae-4273-96eb-032412ef2904 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050281 Aug 05 02:26:24.963771 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 388/774] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:26:24 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 02:26:25.018913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ec1b8df0-9da7-4bc0-8ac6-f17a6fc73c77 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:25.019491 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ec1b8df0-9da7-4bc0-8ac6-f17a6fc73c77 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:25.034745 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ec1b8df0-9da7-4bc0-8ac6-f17a6fc73c77 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:25.035224 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ec1b8df0-9da7-4bc0-8ac6-f17a6fc73c77 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:25.035656 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ec1b8df0-9da7-4bc0-8ac6-f17a6fc73c77 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:25.036354 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ec1b8df0-9da7-4bc0-8ac6-f17a6fc73c77 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:25.036813 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ec1b8df0-9da7-4bc0-8ac6-f17a6fc73c77 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:25.037231 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ec1b8df0-9da7-4bc0-8ac6-f17a6fc73c77 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:25.062270 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ec1b8df0-9da7-4bc0-8ac6-f17a6fc73c77 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:26:25.134805 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ec1b8df0-9da7-4bc0-8ac6-f17a6fc73c77 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 204 len: 0 microversion: 2.1 time: 0.119252 Aug 05 02:26:25.136202 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 387/775] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:26:25 2022] DELETE /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:26:25.144972 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8c43b5a1-e192-495a-ad76-21c2af288ead tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:25.145578 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8c43b5a1-e192-495a-ad76-21c2af288ead tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:25.152565 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c43b5a1-e192-495a-ad76-21c2af288ead tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:25.153362 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c43b5a1-e192-495a-ad76-21c2af288ead tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:25.153866 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c43b5a1-e192-495a-ad76-21c2af288ead tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:25.154651 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c43b5a1-e192-495a-ad76-21c2af288ead tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:25.155115 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c43b5a1-e192-495a-ad76-21c2af288ead tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:25.155988 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c43b5a1-e192-495a-ad76-21c2af288ead tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:25.289039 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8c43b5a1-e192-495a-ad76-21c2af288ead tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:25.296927 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8c43b5a1-e192-495a-ad76-21c2af288ead tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1682 microversion: 2.1 time: 0.156442 Aug 05 02:26:25.297482 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 389/776] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:25 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:26.319202 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1d1886dc-4949-4f87-a44b-5d9ac965bbad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:26.319895 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1d1886dc-4949-4f87-a44b-5d9ac965bbad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:26.326374 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d1886dc-4949-4f87-a44b-5d9ac965bbad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:26.326849 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d1886dc-4949-4f87-a44b-5d9ac965bbad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:26.327281 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d1886dc-4949-4f87-a44b-5d9ac965bbad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:26.327958 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d1886dc-4949-4f87-a44b-5d9ac965bbad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:26.328432 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d1886dc-4949-4f87-a44b-5d9ac965bbad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:26.328853 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1d1886dc-4949-4f87-a44b-5d9ac965bbad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:26.458461 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1d1886dc-4949-4f87-a44b-5d9ac965bbad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:26.466692 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1d1886dc-4949-4f87-a44b-5d9ac965bbad tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1682 microversion: 2.1 time: 0.151739 Aug 05 02:26:26.467243 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 388/777] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:26 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:26:27.487774 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-84eff881-cc08-4982-9ae6-b00cc7e6ba51 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:27.488686 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-84eff881-cc08-4982-9ae6-b00cc7e6ba51 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:27.494949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84eff881-cc08-4982-9ae6-b00cc7e6ba51 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:27.495428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84eff881-cc08-4982-9ae6-b00cc7e6ba51 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:27.495858 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84eff881-cc08-4982-9ae6-b00cc7e6ba51 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:27.496588 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84eff881-cc08-4982-9ae6-b00cc7e6ba51 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:27.497041 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84eff881-cc08-4982-9ae6-b00cc7e6ba51 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:27.497460 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84eff881-cc08-4982-9ae6-b00cc7e6ba51 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:27.638794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-84eff881-cc08-4982-9ae6-b00cc7e6ba51 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:27.654423 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-84eff881-cc08-4982-9ae6-b00cc7e6ba51 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1682 microversion: 2.1 time: 0.170613 Aug 05 02:26:27.655304 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 390/778] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:27 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:27.918290 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-4e307ae7-8cfc-4772-bc09-45fe2fc4f55e req-73e73b96-08d1-4b2c-bf1c-b1678a2d18a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a387642-9e46-4a64-8017-43786f426b70", "name": "network-vif-deleted", "tag": "7885d180-df69-43cf-b111-f789955314dc"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:27.929845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4e307ae7-8cfc-4772-bc09-45fe2fc4f55e req-73e73b96-08d1-4b2c-bf1c-b1678a2d18a4 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:27.930659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4e307ae7-8cfc-4772-bc09-45fe2fc4f55e req-73e73b96-08d1-4b2c-bf1c-b1678a2d18a4 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:27.931321 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4e307ae7-8cfc-4772-bc09-45fe2fc4f55e req-73e73b96-08d1-4b2c-bf1c-b1678a2d18a4 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:27.944146 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-4e307ae7-8cfc-4772-bc09-45fe2fc4f55e req-73e73b96-08d1-4b2c-bf1c-b1678a2d18a4 service nova] Creating event network-vif-deleted:7885d180-df69-43cf-b111-f789955314dc for instance 1a387642-9e46-4a64-8017-43786f426b70 on hv-cinder-81558 Aug 05 02:26:27.949917 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-4e307ae7-8cfc-4772-bc09-45fe2fc4f55e req-73e73b96-08d1-4b2c-bf1c-b1678a2d18a4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035335 Aug 05 02:26:27.950511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 389/779] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:26:28.676402 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5a6c7a5d-79cd-4470-99d4-e5a6f2488b71 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:28.677055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5a6c7a5d-79cd-4470-99d4-e5a6f2488b71 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:28.683624 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a6c7a5d-79cd-4470-99d4-e5a6f2488b71 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:28.684106 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a6c7a5d-79cd-4470-99d4-e5a6f2488b71 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:28.684583 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a6c7a5d-79cd-4470-99d4-e5a6f2488b71 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:28.685310 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a6c7a5d-79cd-4470-99d4-e5a6f2488b71 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:28.685756 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a6c7a5d-79cd-4470-99d4-e5a6f2488b71 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:28.686171 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a6c7a5d-79cd-4470-99d4-e5a6f2488b71 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:28.717001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a6c7a5d-79cd-4470-99d4-e5a6f2488b71 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:28.717469 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a6c7a5d-79cd-4470-99d4-e5a6f2488b71 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:28.717898 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a6c7a5d-79cd-4470-99d4-e5a6f2488b71 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:28.718337 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-5a6c7a5d-79cd-4470-99d4-e5a6f2488b71 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lazy-loading 'fault' on Instance uuid 1a387642-9e46-4a64-8017-43786f426b70 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:26:28.759710 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a6c7a5d-79cd-4470-99d4-e5a6f2488b71 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:28.767597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5a6c7a5d-79cd-4470-99d4-e5a6f2488b71 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 200 len: 1332 microversion: 2.1 time: 0.095020 Aug 05 02:26:28.770145 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 391/780] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:28 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:29.789670 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-09aa524f-e916-44e5-8079-0f3310166c1b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:29.790364 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-09aa524f-e916-44e5-8079-0f3310166c1b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:29.797391 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09aa524f-e916-44e5-8079-0f3310166c1b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:29.797872 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09aa524f-e916-44e5-8079-0f3310166c1b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:29.798305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09aa524f-e916-44e5-8079-0f3310166c1b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:29.798984 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09aa524f-e916-44e5-8079-0f3310166c1b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:29.799436 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09aa524f-e916-44e5-8079-0f3310166c1b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:29.799858 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09aa524f-e916-44e5-8079-0f3310166c1b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:29.814624 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-09aa524f-e916-44e5-8079-0f3310166c1b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] HTTP exception thrown: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-09aa524f-e916-44e5-8079-0f3310166c1b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Request method failure captured: Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 HTTP/1.1 Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5pSyPEti3j-9gLBxlgA1L_GuWB6iJvenWVBmfr31mrg4vu4HTgr4mx0c2q3ZmjrMdxdtLzCg8wRia849DSEc7AfP2crmxulEg45Cq3I2oORZ75mc5ksg7ZmJKJ4cA2qZbyq7NZRhJeqx1H2xWUpibdSGnuQ0avaMqjO9VbCjnpzbo Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:26:29.816210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:26:29.818150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ad6a220b99d94a648150476bf0a01e50", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}] Aug 05 02:26:29.818150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:26:29.818150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:26:29.818150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:26:29.818150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:26:29.818150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:26:29.818150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:26:29.818150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 600f51be8202427fb3691db566ed2ff2 Aug 05 02:26:29.818150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:26:29.818150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:26:29.818150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. Aug 05 02:26:29.818150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': '1a387642-9e46-4a64-8017-43786f426b70'} Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:26:29.819207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. Aug 05 02:26:29.820736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:26:29.822388 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-09aa524f-e916-44e5-8079-0f3310166c1b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Returning 404 to user: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:26:29.822388 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-09aa524f-e916-44e5-8079-0f3310166c1b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 404 len: 111 microversion: 2.1 time: 0.032602 Aug 05 02:26:29.822388 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 390/781] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:29 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:26:29.826670 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6d80bb03-1b19-41fc-8473-41179c88ffdd tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '.version_select at 0x7fa65c5eaee0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:29.847190 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6d80bb03-1b19-41fc-8473-41179c88ffdd tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1211629349" status: 202 len: 0 microversion: 2.1 time: 0.024618 Aug 05 02:26:29.847783 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 392/782] 10.222.0.15 () {58 vars in 1221 bytes} [Fri Aug 5 02:26:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1211629349 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 02:26:30.494554 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7513ca74-dc44-4092-aee4-11a3abe8be51 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Action: 'create', calling method: .version_select at 0x7fa65c5b39d0>, body: {"keypair": {"name": "tempest-keypair-31622562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaCFWZvNxvosMD3SSRRMyAooPNhTdstwOIwsmw9UjZYCiMlsbIYUgl7hPn/DOJNar6rv0Tx4313wKC2UGZZBHk9RZcDmY4Pt7XdLgRUd3ZVvPs0BIzjYOwfMBfaCN5uIw=="}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:30.509347 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-7513ca74-dc44-4092-aee4-11a3abe8be51 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Getting quotas for project ad6a220b99d94a648150476bf0a01e50. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:26:30.513576 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-7513ca74-dc44-4092-aee4-11a3abe8be51 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Getting quotas for user 600f51be8202427fb3691db566ed2ff2 and project ad6a220b99d94a648150476bf0a01e50. Resources: {'key_pairs'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:26:30.534532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7513ca74-dc44-4092-aee4-11a3abe8be51 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.043986 Aug 05 02:26:30.535108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 391/783] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Aug 5 02:26:30 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:26:31.654801 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-393598497", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "528bd4e2-8ce2-403c-8a20-be166348ecb8"}], "security_groups": [{"name": "tempest-securitygroup--1605049886"}], "key_name": "tempest-keypair-31622562", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:31.759327 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] validate_networks() for [('528bd4e2-8ce2-403c-8a20-be166348ecb8', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:26:32.160401 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:26:32.160834 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:26:32.161307 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:26:32.161715 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:26:32.162127 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:26:32.171270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:32.171744 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:32.172207 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:32.172961 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:32.173417 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:32.173842 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:32.191014 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Getting quotas for project ad6a220b99d94a648150476bf0a01e50. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:26:32.195044 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Getting quotas for user 600f51be8202427fb3691db566ed2ff2 and project ad6a220b99d94a648150476bf0a01e50. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:26:32.205859 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:26:32.208095 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:26:32.254349 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-88846728-9c1b-4b5f-a3dd-58df46c2ab3f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.604974 Aug 05 02:26:32.255152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 393/784] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:26:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:26:32.266748 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0d8b87c7-01cd-4bd4-aae9-b8be428c0215 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:32.267356 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0d8b87c7-01cd-4bd4-aae9-b8be428c0215 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:32.327429 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0d8b87c7-01cd-4bd4-aae9-b8be428c0215 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:32.334016 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0d8b87c7-01cd-4bd4-aae9-b8be428c0215 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1239 microversion: 2.1 time: 0.071717 Aug 05 02:26:32.334576 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 392/785] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:32 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:33.355543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1dc02458-6816-4af4-8f2a-71b242307617 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:33.356130 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1dc02458-6816-4af4-8f2a-71b242307617 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:33.362804 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dc02458-6816-4af4-8f2a-71b242307617 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:33.363286 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dc02458-6816-4af4-8f2a-71b242307617 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:33.363721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dc02458-6816-4af4-8f2a-71b242307617 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:33.364437 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dc02458-6816-4af4-8f2a-71b242307617 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:33.364888 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dc02458-6816-4af4-8f2a-71b242307617 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:33.365318 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1dc02458-6816-4af4-8f2a-71b242307617 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:33.426956 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1dc02458-6816-4af4-8f2a-71b242307617 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:33.435156 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1dc02458-6816-4af4-8f2a-71b242307617 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1291 microversion: 2.1 time: 0.084028 Aug 05 02:26:33.435723 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 394/786] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:33 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1291 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:34.454965 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1af1e2e4-5fd7-4195-80d2-743af452703b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:34.455668 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1af1e2e4-5fd7-4195-80d2-743af452703b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:34.462075 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1af1e2e4-5fd7-4195-80d2-743af452703b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:34.462718 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1af1e2e4-5fd7-4195-80d2-743af452703b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:34.463341 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1af1e2e4-5fd7-4195-80d2-743af452703b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:34.464424 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1af1e2e4-5fd7-4195-80d2-743af452703b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:34.464879 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1af1e2e4-5fd7-4195-80d2-743af452703b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:34.465302 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1af1e2e4-5fd7-4195-80d2-743af452703b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:34.726616 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1af1e2e4-5fd7-4195-80d2-743af452703b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:34.734022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1af1e2e4-5fd7-4195-80d2-743af452703b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1365 microversion: 2.1 time: 0.282888 Aug 05 02:26:34.734613 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 393/787] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:34 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:35.220960 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-da572fd4-2d24-432e-951c-536699d59253 req-604a31d1-118b-4c40-8bcb-48dd1d316236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a74b7e-5eed-4b83-8abb-d300e6662c14", "tag": "470a70cc-8420-4e3a-996b-d0527d557db3"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:35.226443 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:35.234717 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-da572fd4-2d24-432e-951c-536699d59253 req-604a31d1-118b-4c40-8bcb-48dd1d316236 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:35.235219 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-da572fd4-2d24-432e-951c-536699d59253 req-604a31d1-118b-4c40-8bcb-48dd1d316236 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:35.235647 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-da572fd4-2d24-432e-951c-536699d59253 req-604a31d1-118b-4c40-8bcb-48dd1d316236 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:35.248371 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-da572fd4-2d24-432e-951c-536699d59253 req-604a31d1-118b-4c40-8bcb-48dd1d316236 service nova] Creating event network-changed:470a70cc-8420-4e3a-996b-d0527d557db3 for instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 on hv-cinder-81558 Aug 05 02:26:35.253055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-da572fd4-2d24-432e-951c-536699d59253 req-604a31d1-118b-4c40-8bcb-48dd1d316236 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035695 Aug 05 02:26:35.253819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 395/788] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:26:35.754486 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-761dc765-ab06-4c4b-8017-09d3300e8d98 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:35.755096 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-761dc765-ab06-4c4b-8017-09d3300e8d98 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:35.762223 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-761dc765-ab06-4c4b-8017-09d3300e8d98 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:35.762702 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-761dc765-ab06-4c4b-8017-09d3300e8d98 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:35.763135 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-761dc765-ab06-4c4b-8017-09d3300e8d98 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:35.763835 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-761dc765-ab06-4c4b-8017-09d3300e8d98 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:35.764334 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-761dc765-ab06-4c4b-8017-09d3300e8d98 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:35.765053 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-761dc765-ab06-4c4b-8017-09d3300e8d98 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:35.903171 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-761dc765-ab06-4c4b-8017-09d3300e8d98 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:35.910500 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-761dc765-ab06-4c4b-8017-09d3300e8d98 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1365 microversion: 2.1 time: 0.160043 Aug 05 02:26:35.911056 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 394/789] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:35 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:36.932619 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1b4c0532-4b2b-445a-80ee-91de2a6d429c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:36.933309 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1b4c0532-4b2b-445a-80ee-91de2a6d429c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:36.939555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b4c0532-4b2b-445a-80ee-91de2a6d429c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:36.940030 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b4c0532-4b2b-445a-80ee-91de2a6d429c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:36.940492 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b4c0532-4b2b-445a-80ee-91de2a6d429c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:36.941170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b4c0532-4b2b-445a-80ee-91de2a6d429c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:36.941614 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b4c0532-4b2b-445a-80ee-91de2a6d429c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:36.942031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b4c0532-4b2b-445a-80ee-91de2a6d429c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:37.070812 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1b4c0532-4b2b-445a-80ee-91de2a6d429c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:37.078212 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1b4c0532-4b2b-445a-80ee-91de2a6d429c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1365 microversion: 2.1 time: 0.150904 Aug 05 02:26:37.078764 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 396/790] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:36 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:38.100059 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b79dcc3b-0d95-4b9e-aed7-8aebbc0dea60 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:38.100628 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b79dcc3b-0d95-4b9e-aed7-8aebbc0dea60 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:38.107558 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b79dcc3b-0d95-4b9e-aed7-8aebbc0dea60 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:38.108036 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b79dcc3b-0d95-4b9e-aed7-8aebbc0dea60 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:38.108513 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b79dcc3b-0d95-4b9e-aed7-8aebbc0dea60 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:38.109195 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b79dcc3b-0d95-4b9e-aed7-8aebbc0dea60 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:38.109649 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b79dcc3b-0d95-4b9e-aed7-8aebbc0dea60 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:38.110067 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b79dcc3b-0d95-4b9e-aed7-8aebbc0dea60 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:38.241064 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b79dcc3b-0d95-4b9e-aed7-8aebbc0dea60 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:38.249603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b79dcc3b-0d95-4b9e-aed7-8aebbc0dea60 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1365 microversion: 2.1 time: 0.153950 Aug 05 02:26:38.250156 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 395/791] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:38 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:39.270516 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8ba91278-272a-4a79-a094-672040471f31 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:39.271152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8ba91278-272a-4a79-a094-672040471f31 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:39.278693 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ba91278-272a-4a79-a094-672040471f31 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:39.279176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ba91278-272a-4a79-a094-672040471f31 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:39.279603 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ba91278-272a-4a79-a094-672040471f31 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:39.280307 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ba91278-272a-4a79-a094-672040471f31 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:39.280776 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ba91278-272a-4a79-a094-672040471f31 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:39.281198 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ba91278-272a-4a79-a094-672040471f31 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:39.413901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8ba91278-272a-4a79-a094-672040471f31 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:39.421216 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8ba91278-272a-4a79-a094-672040471f31 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1365 microversion: 2.1 time: 0.154555 Aug 05 02:26:39.421777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 397/792] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:39 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:40.441301 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d09b50f5-3d2d-4b2d-a18d-e03044142471 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:40.441906 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d09b50f5-3d2d-4b2d-a18d-e03044142471 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:40.444437 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:40.450596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d09b50f5-3d2d-4b2d-a18d-e03044142471 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:40.451079 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d09b50f5-3d2d-4b2d-a18d-e03044142471 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:40.451511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d09b50f5-3d2d-4b2d-a18d-e03044142471 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:40.452205 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d09b50f5-3d2d-4b2d-a18d-e03044142471 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:40.452688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d09b50f5-3d2d-4b2d-a18d-e03044142471 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:40.453108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d09b50f5-3d2d-4b2d-a18d-e03044142471 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:40.585391 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d09b50f5-3d2d-4b2d-a18d-e03044142471 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:40.593512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d09b50f5-3d2d-4b2d-a18d-e03044142471 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1365 microversion: 2.1 time: 0.156055 Aug 05 02:26:40.594081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 396/793] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:40 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:41.614097 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5bc65e21-071f-4a42-882b-df0ab876abef tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:41.614701 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5bc65e21-071f-4a42-882b-df0ab876abef tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:41.621778 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5bc65e21-071f-4a42-882b-df0ab876abef tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:41.622252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5bc65e21-071f-4a42-882b-df0ab876abef tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:41.622681 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5bc65e21-071f-4a42-882b-df0ab876abef tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:41.623365 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5bc65e21-071f-4a42-882b-df0ab876abef tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:41.623815 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5bc65e21-071f-4a42-882b-df0ab876abef tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:41.624236 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5bc65e21-071f-4a42-882b-df0ab876abef tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:41.757663 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5bc65e21-071f-4a42-882b-df0ab876abef tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:41.765558 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5bc65e21-071f-4a42-882b-df0ab876abef tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1365 microversion: 2.1 time: 0.155236 Aug 05 02:26:41.766137 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 398/794] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:41 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:41.878297 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-aa5fee74-4cfa-4590-852d-ba962e584664 req-7b1f2cb3-2e6c-437b-8045-427dbf973bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a74b7e-5eed-4b83-8abb-d300e6662c14", "name": "network-vif-plugged", "status": "completed", "tag": "470a70cc-8420-4e3a-996b-d0527d557db3"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:41.887619 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-aa5fee74-4cfa-4590-852d-ba962e584664 req-7b1f2cb3-2e6c-437b-8045-427dbf973bdd service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:41.888123 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-aa5fee74-4cfa-4590-852d-ba962e584664 req-7b1f2cb3-2e6c-437b-8045-427dbf973bdd service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:41.888571 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-aa5fee74-4cfa-4590-852d-ba962e584664 req-7b1f2cb3-2e6c-437b-8045-427dbf973bdd service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:41.899282 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-aa5fee74-4cfa-4590-852d-ba962e584664 req-7b1f2cb3-2e6c-437b-8045-427dbf973bdd service nova] Creating event network-vif-plugged:470a70cc-8420-4e3a-996b-d0527d557db3 for instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 on hv-cinder-81558 Aug 05 02:26:41.904136 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-aa5fee74-4cfa-4590-852d-ba962e584664 req-7b1f2cb3-2e6c-437b-8045-427dbf973bdd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089390 Aug 05 02:26:41.904753 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 397/795] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:26:42.785506 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-59e17212-d206-4716-9409-4303b4ee6fb1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:42.786112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-59e17212-d206-4716-9409-4303b4ee6fb1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:42.788067 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:42.788779 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:42.795255 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59e17212-d206-4716-9409-4303b4ee6fb1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:42.795735 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59e17212-d206-4716-9409-4303b4ee6fb1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:42.796167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59e17212-d206-4716-9409-4303b4ee6fb1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:42.796886 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59e17212-d206-4716-9409-4303b4ee6fb1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:42.797339 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59e17212-d206-4716-9409-4303b4ee6fb1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:42.797765 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59e17212-d206-4716-9409-4303b4ee6fb1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:42.815674 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:42.926883 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-59e17212-d206-4716-9409-4303b4ee6fb1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:42.934985 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-59e17212-d206-4716-9409-4303b4ee6fb1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1365 microversion: 2.1 time: 0.153347 Aug 05 02:26:42.935545 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 399/796] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:42 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:43.091600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:43.096589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-58cd7423-c060-4e67-9d79-502612e08644 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:43.097166 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-58cd7423-c060-4e67-9d79-502612e08644 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:43.103430 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58cd7423-c060-4e67-9d79-502612e08644 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:43.104576 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58cd7423-c060-4e67-9d79-502612e08644 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:43.105023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58cd7423-c060-4e67-9d79-502612e08644 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:43.105709 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58cd7423-c060-4e67-9d79-502612e08644 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:43.106161 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58cd7423-c060-4e67-9d79-502612e08644 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:43.106586 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-58cd7423-c060-4e67-9d79-502612e08644 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:43.134291 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-58cd7423-c060-4e67-9d79-502612e08644 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/os-volume_attachments/2751bbfe-0517-4041-83bf-17de153f0afa" status: 200 len: 194 microversion: 2.20 time: 0.043616 Aug 05 02:26:43.135499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 398/797] 10.222.0.15 () {60 vars in 1454 bytes} [Fri Aug 5 02:26:43 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/os-volume_attachments/2751bbfe-0517-4041-83bf-17de153f0afa => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:26:43.201683 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b540d575-1eeb-4aed-94d3-59a973fe397e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:43.202169 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b540d575-1eeb-4aed-94d3-59a973fe397e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:43.208001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b540d575-1eeb-4aed-94d3-59a973fe397e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:43.208525 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b540d575-1eeb-4aed-94d3-59a973fe397e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:43.208956 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b540d575-1eeb-4aed-94d3-59a973fe397e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:43.209638 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b540d575-1eeb-4aed-94d3-59a973fe397e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:43.210084 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b540d575-1eeb-4aed-94d3-59a973fe397e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:43.210503 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b540d575-1eeb-4aed-94d3-59a973fe397e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:43.292275 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-b540d575-1eeb-4aed-94d3-59a973fe397e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lazy-loading 'services' on Instance uuid 319a8a64-7b50-4fff-93b6-4498b53265ab {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:26:43.363079 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b540d575-1eeb-4aed-94d3-59a973fe397e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "DELETE /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/os-volume_attachments/2751bbfe-0517-4041-83bf-17de153f0afa" status: 202 len: 0 microversion: 2.20 time: 0.165664 Aug 05 02:26:43.363690 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 400/798] 10.222.0.15 () {60 vars in 1457 bytes} [Fri Aug 5 02:26:43 2022] DELETE /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/os-volume_attachments/2751bbfe-0517-4041-83bf-17de153f0afa => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:26:43.372048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0b1144ef-b833-420f-aa88-3bc42a3bd9a5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:43.374243 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0b1144ef-b833-420f-aa88-3bc42a3bd9a5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:43.379983 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b1144ef-b833-420f-aa88-3bc42a3bd9a5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:43.380732 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b1144ef-b833-420f-aa88-3bc42a3bd9a5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:43.381127 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b1144ef-b833-420f-aa88-3bc42a3bd9a5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:43.381813 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b1144ef-b833-420f-aa88-3bc42a3bd9a5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:43.382255 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b1144ef-b833-420f-aa88-3bc42a3bd9a5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:43.382670 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0b1144ef-b833-420f-aa88-3bc42a3bd9a5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:43.413145 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0b1144ef-b833-420f-aa88-3bc42a3bd9a5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044857 Aug 05 02:26:43.413708 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 399/799] 10.222.0.15 () {60 vars in 1343 bytes} [Fri Aug 5 02:26:43 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:26:43.956627 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7d24cc59-e251-4e6d-933f-7a4978d6e038 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:43.957318 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7d24cc59-e251-4e6d-933f-7a4978d6e038 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:43.964274 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d24cc59-e251-4e6d-933f-7a4978d6e038 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:43.964779 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d24cc59-e251-4e6d-933f-7a4978d6e038 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:43.965214 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d24cc59-e251-4e6d-933f-7a4978d6e038 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:43.965902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d24cc59-e251-4e6d-933f-7a4978d6e038 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:43.966352 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d24cc59-e251-4e6d-933f-7a4978d6e038 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:43.966769 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d24cc59-e251-4e6d-933f-7a4978d6e038 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:44.100304 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7d24cc59-e251-4e6d-933f-7a4978d6e038 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:44.108938 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7d24cc59-e251-4e6d-933f-7a4978d6e038 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1365 microversion: 2.1 time: 0.156970 Aug 05 02:26:44.109499 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 401/800] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:43 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:44.426358 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-df54dd45-9a3f-4a5d-b9e4-6fe43f25b1ba tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:44.428586 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-df54dd45-9a3f-4a5d-b9e4-6fe43f25b1ba tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:44.434841 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df54dd45-9a3f-4a5d-b9e4-6fe43f25b1ba tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:44.435312 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df54dd45-9a3f-4a5d-b9e4-6fe43f25b1ba tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:44.435742 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df54dd45-9a3f-4a5d-b9e4-6fe43f25b1ba tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:44.436446 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df54dd45-9a3f-4a5d-b9e4-6fe43f25b1ba tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:44.436897 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df54dd45-9a3f-4a5d-b9e4-6fe43f25b1ba tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:44.437317 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df54dd45-9a3f-4a5d-b9e4-6fe43f25b1ba tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:44.465719 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-df54dd45-9a3f-4a5d-b9e4-6fe43f25b1ba tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043342 Aug 05 02:26:44.466350 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 400/801] 10.222.0.15 () {60 vars in 1343 bytes} [Fri Aug 5 02:26:44 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:26:45.130096 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fd72baf2-0dbf-431b-8f06-25fada928dac tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:45.130643 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fd72baf2-0dbf-431b-8f06-25fada928dac tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:45.137339 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd72baf2-0dbf-431b-8f06-25fada928dac tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:45.137826 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd72baf2-0dbf-431b-8f06-25fada928dac tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:45.138262 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd72baf2-0dbf-431b-8f06-25fada928dac tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:45.138950 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd72baf2-0dbf-431b-8f06-25fada928dac tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:45.139400 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd72baf2-0dbf-431b-8f06-25fada928dac tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:45.139819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd72baf2-0dbf-431b-8f06-25fada928dac tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:45.272659 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fd72baf2-0dbf-431b-8f06-25fada928dac tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:45.280936 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fd72baf2-0dbf-431b-8f06-25fada928dac tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1554 microversion: 2.1 time: 0.154756 Aug 05 02:26:45.281503 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 402/802] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:26:45 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:45.302664 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5026cdf4-b0a1-4d23-a73e-351034e9b788 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:45.303153 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5026cdf4-b0a1-4d23-a73e-351034e9b788 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:45.309789 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5026cdf4-b0a1-4d23-a73e-351034e9b788 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:45.310272 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5026cdf4-b0a1-4d23-a73e-351034e9b788 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:45.310704 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5026cdf4-b0a1-4d23-a73e-351034e9b788 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:45.311389 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5026cdf4-b0a1-4d23-a73e-351034e9b788 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:45.311838 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5026cdf4-b0a1-4d23-a73e-351034e9b788 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:45.312259 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5026cdf4-b0a1-4d23-a73e-351034e9b788 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:45.393113 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5026cdf4-b0a1-4d23-a73e-351034e9b788 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094294 Aug 05 02:26:45.393711 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 401/803] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Aug 5 02:26:45 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:26:45.478322 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c4432c9d-9345-4ca5-93af-59497af026af tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:45.480901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c4432c9d-9345-4ca5-93af-59497af026af tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:45.486981 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4432c9d-9345-4ca5-93af-59497af026af tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:45.487462 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4432c9d-9345-4ca5-93af-59497af026af tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:45.487891 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4432c9d-9345-4ca5-93af-59497af026af tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:45.488612 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4432c9d-9345-4ca5-93af-59497af026af tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:45.489067 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4432c9d-9345-4ca5-93af-59497af026af tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:45.489484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4432c9d-9345-4ca5-93af-59497af026af tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:45.517965 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c4432c9d-9345-4ca5-93af-59497af026af tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043593 Aug 05 02:26:45.518520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 403/804] 10.222.0.15 () {60 vars in 1343 bytes} [Fri Aug 5 02:26:45 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:26:45.579918 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d2cd7fc3-ffcf-4e61-a0eb-c0f0c4c9a751 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:45.580547 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d2cd7fc3-ffcf-4e61-a0eb-c0f0c4c9a751 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:45.586726 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2cd7fc3-ffcf-4e61-a0eb-c0f0c4c9a751 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:45.587222 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2cd7fc3-ffcf-4e61-a0eb-c0f0c4c9a751 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:45.587654 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2cd7fc3-ffcf-4e61-a0eb-c0f0c4c9a751 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:45.589858 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2cd7fc3-ffcf-4e61-a0eb-c0f0c4c9a751 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:45.590320 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2cd7fc3-ffcf-4e61-a0eb-c0f0c4c9a751 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:45.590777 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2cd7fc3-ffcf-4e61-a0eb-c0f0c4c9a751 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:45.617995 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d2cd7fc3-ffcf-4e61-a0eb-c0f0c4c9a751 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:26:45.695288 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d2cd7fc3-ffcf-4e61-a0eb-c0f0c4c9a751 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "DELETE /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 204 len: 0 microversion: 2.20 time: 0.118921 Aug 05 02:26:45.698428 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 402/805] 10.222.0.15 () {60 vars in 1280 bytes} [Fri Aug 5 02:26:45 2022] DELETE /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 02:26:45.707584 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2970db92-e428-4087-b675-d0e0f3faca95 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:45.708561 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2970db92-e428-4087-b675-d0e0f3faca95 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:45.716272 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2970db92-e428-4087-b675-d0e0f3faca95 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:45.716853 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2970db92-e428-4087-b675-d0e0f3faca95 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:45.717361 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2970db92-e428-4087-b675-d0e0f3faca95 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:45.718124 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2970db92-e428-4087-b675-d0e0f3faca95 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:45.718644 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2970db92-e428-4087-b675-d0e0f3faca95 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:45.719157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2970db92-e428-4087-b675-d0e0f3faca95 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:45.853722 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2970db92-e428-4087-b675-d0e0f3faca95 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:45.861638 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2970db92-e428-4087-b675-d0e0f3faca95 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:45.863136 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2970db92-e428-4087-b675-d0e0f3faca95 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:45.864284 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2970db92-e428-4087-b675-d0e0f3faca95 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.162391 Aug 05 02:26:45.864860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 404/806] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:26:45 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:26:46.331727 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-84d636c6-b4a9-43dd-a246-544a9118402a req-130857ba-40b8-4055-8855-d97a70d5579a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a74b7e-5eed-4b83-8abb-d300e6662c14", "tag": "470a70cc-8420-4e3a-996b-d0527d557db3"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:46.342075 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-84d636c6-b4a9-43dd-a246-544a9118402a req-130857ba-40b8-4055-8855-d97a70d5579a service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:46.342630 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-84d636c6-b4a9-43dd-a246-544a9118402a req-130857ba-40b8-4055-8855-d97a70d5579a service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:46.343064 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-84d636c6-b4a9-43dd-a246-544a9118402a req-130857ba-40b8-4055-8855-d97a70d5579a service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:46.355049 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-84d636c6-b4a9-43dd-a246-544a9118402a req-130857ba-40b8-4055-8855-d97a70d5579a service nova] Creating event network-changed:470a70cc-8420-4e3a-996b-d0527d557db3 for instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 on hv-cinder-81558 Aug 05 02:26:46.360007 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-84d636c6-b4a9-43dd-a246-544a9118402a req-130857ba-40b8-4055-8855-d97a70d5579a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032320 Aug 05 02:26:46.360634 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 403/807] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:26:46.889998 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f9f5eaf9-42b1-449b-a80c-a4cab2391bf6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:46.890562 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f9f5eaf9-42b1-449b-a80c-a4cab2391bf6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:46.896906 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9f5eaf9-42b1-449b-a80c-a4cab2391bf6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:46.897394 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9f5eaf9-42b1-449b-a80c-a4cab2391bf6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:46.897831 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9f5eaf9-42b1-449b-a80c-a4cab2391bf6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:46.898529 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9f5eaf9-42b1-449b-a80c-a4cab2391bf6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:46.898982 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9f5eaf9-42b1-449b-a80c-a4cab2391bf6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:46.899407 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f9f5eaf9-42b1-449b-a80c-a4cab2391bf6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:47.037228 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f9f5eaf9-42b1-449b-a80c-a4cab2391bf6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:47.045746 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f9f5eaf9-42b1-449b-a80c-a4cab2391bf6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:47.047238 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f9f5eaf9-42b1-449b-a80c-a4cab2391bf6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:47.048415 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f9f5eaf9-42b1-449b-a80c-a4cab2391bf6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.162399 Aug 05 02:26:47.048968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 405/808] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:26:46 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:26:48.073241 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-19279044-4da9-4bb9-9905-9a473b65e8a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:48.074252 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-19279044-4da9-4bb9-9905-9a473b65e8a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:48.080765 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19279044-4da9-4bb9-9905-9a473b65e8a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:48.081242 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19279044-4da9-4bb9-9905-9a473b65e8a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:48.081669 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19279044-4da9-4bb9-9905-9a473b65e8a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:48.082351 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19279044-4da9-4bb9-9905-9a473b65e8a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:48.082903 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19279044-4da9-4bb9-9905-9a473b65e8a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:48.083326 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19279044-4da9-4bb9-9905-9a473b65e8a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:48.087469 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:48.298550 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-19279044-4da9-4bb9-9905-9a473b65e8a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:48.307157 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-19279044-4da9-4bb9-9905-9a473b65e8a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:48.308958 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-19279044-4da9-4bb9-9905-9a473b65e8a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:48.310115 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-19279044-4da9-4bb9-9905-9a473b65e8a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1722 microversion: 2.20 time: 0.241881 Aug 05 02:26:48.310674 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 404/809] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:26:48 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:26:48.876457 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-c6ff72e7-f22c-4e4e-a555-0885d679dc03 req-a6adb5ab-85fd-45d2-baba-8b1986f3fc70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319a8a64-7b50-4fff-93b6-4498b53265ab", "name": "network-vif-deleted", "tag": "661635b8-8836-4704-91ee-343c5d3a40eb"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:48.887129 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c6ff72e7-f22c-4e4e-a555-0885d679dc03 req-a6adb5ab-85fd-45d2-baba-8b1986f3fc70 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:48.887608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c6ff72e7-f22c-4e4e-a555-0885d679dc03 req-a6adb5ab-85fd-45d2-baba-8b1986f3fc70 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:48.888061 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c6ff72e7-f22c-4e4e-a555-0885d679dc03 req-a6adb5ab-85fd-45d2-baba-8b1986f3fc70 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:48.899281 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-c6ff72e7-f22c-4e4e-a555-0885d679dc03 req-a6adb5ab-85fd-45d2-baba-8b1986f3fc70 service nova] Creating event network-vif-deleted:661635b8-8836-4704-91ee-343c5d3a40eb for instance 319a8a64-7b50-4fff-93b6-4498b53265ab on hv-cinder-81558 Aug 05 02:26:48.905269 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-c6ff72e7-f22c-4e4e-a555-0885d679dc03 req-a6adb5ab-85fd-45d2-baba-8b1986f3fc70 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033043 Aug 05 02:26:48.906040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 406/810] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:26:49.333120 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-16ff61d7-6194-4c36-be4c-d8188d7aa202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:49.333810 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-16ff61d7-6194-4c36-be4c-d8188d7aa202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:49.340987 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16ff61d7-6194-4c36-be4c-d8188d7aa202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:49.341475 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16ff61d7-6194-4c36-be4c-d8188d7aa202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:49.341906 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16ff61d7-6194-4c36-be4c-d8188d7aa202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:49.342631 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16ff61d7-6194-4c36-be4c-d8188d7aa202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:49.343074 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16ff61d7-6194-4c36-be4c-d8188d7aa202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:49.343490 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16ff61d7-6194-4c36-be4c-d8188d7aa202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:49.377511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16ff61d7-6194-4c36-be4c-d8188d7aa202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:49.378003 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16ff61d7-6194-4c36-be4c-d8188d7aa202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:49.378450 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16ff61d7-6194-4c36-be4c-d8188d7aa202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:49.378890 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-16ff61d7-6194-4c36-be4c-d8188d7aa202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lazy-loading 'fault' on Instance uuid 319a8a64-7b50-4fff-93b6-4498b53265ab {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:26:49.427064 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-16ff61d7-6194-4c36-be4c-d8188d7aa202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:49.436222 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-16ff61d7-6194-4c36-be4c-d8188d7aa202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:49.437767 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-16ff61d7-6194-4c36-be4c-d8188d7aa202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:49.438917 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-16ff61d7-6194-4c36-be4c-d8188d7aa202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 200 len: 1371 microversion: 2.20 time: 0.109870 Aug 05 02:26:49.439469 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 405/811] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:26:49 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:26:50.464316 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-21d00a79-6e8a-4667-8bb4-4eec6e6f26cc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:50.465051 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-21d00a79-6e8a-4667-8bb4-4eec6e6f26cc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:50.471060 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21d00a79-6e8a-4667-8bb4-4eec6e6f26cc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:50.471532 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21d00a79-6e8a-4667-8bb4-4eec6e6f26cc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:50.471963 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21d00a79-6e8a-4667-8bb4-4eec6e6f26cc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:50.472744 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21d00a79-6e8a-4667-8bb4-4eec6e6f26cc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:50.473187 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21d00a79-6e8a-4667-8bb4-4eec6e6f26cc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:50.473606 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21d00a79-6e8a-4667-8bb4-4eec6e6f26cc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:50.486398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-21d00a79-6e8a-4667-8bb4-4eec6e6f26cc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] HTTP exception thrown: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-21d00a79-6e8a-4667-8bb4-4eec6e6f26cc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Request method failure captured: Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab HTTP/1.1 Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5yU91JkM-Df5Hrb2J07-uB9jkTSxGC1uczeZcx36j6-RIzeFC8WLrFLO0In7oklMjJU1K26Lznm4FbUDDBB3b6GV67yN6SNxxU9GE5hQGqZstgC3yoQPOXZY01ADRcq3IfXSN6V3mfa3h9YvPh5xrLa00LD7XBHXXTuZcxhnrcBoI Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 6873a99b9878495895acb21ed2133bb6 Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:26:50.487968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:26:50.489694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6873a99b9878495895acb21ed2133bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6873a99b9878495895acb21ed2133bb6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6873a99b9878495895acb21ed2133bb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6873a99b9878495895acb21ed2133bb6"}]}] Aug 05 02:26:50.489694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:26:50.489694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 6873a99b9878495895acb21ed2133bb6 Aug 05 02:26:50.489694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:26:50.489694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-1669462514-project Aug 05 02:26:50.489694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:26:50.489694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:26:50.489694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 3d47613c7085460da42e2179625b3f16 Aug 05 02:26:50.489694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1669462514-project Aug 05 02:26:50.489694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:26:50.489694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. Aug 05 02:26:50.489694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '319a8a64-7b50-4fff-93b6-4498b53265ab'} Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:26:50.490696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. Aug 05 02:26:50.492024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:26:50.493349 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-21d00a79-6e8a-4667-8bb4-4eec6e6f26cc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Returning 404 to user: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:26:50.493349 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-21d00a79-6e8a-4667-8bb4-4eec6e6f26cc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 404 len: 111 microversion: 2.20 time: 0.030043 Aug 05 02:26:50.493349 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 407/812] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:26:50 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 02:26:50.498651 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7dd18561-9d98-421e-9676-697aca9bd48a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '.version_select at 0x7fa660edbaf0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:50.516994 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7dd18561-9d98-421e-9676-697aca9bd48a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660420522" status: 204 len: 0 microversion: 2.20 time: 0.022097 Aug 05 02:26:50.517531 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 406/813] 10.222.0.15 () {60 vars in 1262 bytes} [Fri Aug 5 02:26:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660420522 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 02:26:51.141959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c8cfa1e5-18fc-4103-8e93-14d128bc793b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Action: 'create', calling method: .version_select at 0x7fa65c5ea9d0>, body: {"keypair": {"name": "tempest-keypair-1926461712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzJQ4mu4P6LNMISYZru+CyWNjz1H52LyPoa6FPXkM1LWhz2kFJTgg9HQSyRVLuC1qwyB79NAqd/yYIf6XJKI584CfVxiYxICh47hv1hr1WYnkWbUG16Czm1w85K5RILpg=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:51.157269 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-c8cfa1e5-18fc-4103-8e93-14d128bc793b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Getting quotas for project 6873a99b9878495895acb21ed2133bb6. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:26:51.160956 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-c8cfa1e5-18fc-4103-8e93-14d128bc793b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Getting quotas for user 3d47613c7085460da42e2179625b3f16 and project 6873a99b9878495895acb21ed2133bb6. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:26:51.183336 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c8cfa1e5-18fc-4103-8e93-14d128bc793b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045202 Aug 05 02:26:51.183929 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 408/814] 10.222.0.15 () {62 vars in 1200 bytes} [Fri Aug 5 02:26:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 05 02:26:52.539315 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-937492162", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21fc4037-98aa-44e1-a7ca-1e86cf11ad68"}], "security_groups": [{"name": "tempest-securitygroup--1767583696"}], "key_name": "tempest-keypair-1926461712", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:52.640725 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] validate_networks() for [('21fc4037-98aa-44e1-a7ca-1e86cf11ad68', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:26:53.051024 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:26:53.051449 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:26:53.051920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:26:53.052349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:26:53.052755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:26:53.062788 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:53.063193 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:53.063620 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:53.064349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:53.064807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:53.065224 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:53.081353 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Getting quotas for project 6873a99b9878495895acb21ed2133bb6. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:26:53.085280 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Getting quotas for user 3d47613c7085460da42e2179625b3f16 and project 6873a99b9878495895acb21ed2133bb6. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:26:53.096819 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:26:53.099057 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:26:53.144920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7e45475d-7c52-4028-95e1-1bb2ec4d843e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.610301 Aug 05 02:26:53.145567 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 407/815] 10.222.0.15 () {62 vars in 1188 bytes} [Fri Aug 5 02:26:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 05 02:26:53.157256 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-669b2c26-2ae7-40fd-9e3f-0f5001ab6a2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:53.157902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-669b2c26-2ae7-40fd-9e3f-0f5001ab6a2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:53.215335 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-669b2c26-2ae7-40fd-9e3f-0f5001ab6a2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:53.222462 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-669b2c26-2ae7-40fd-9e3f-0f5001ab6a2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:53.223954 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-669b2c26-2ae7-40fd-9e3f-0f5001ab6a2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:53.225073 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-669b2c26-2ae7-40fd-9e3f-0f5001ab6a2c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1281 microversion: 2.20 time: 0.072397 Aug 05 02:26:53.225622 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 409/816] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:26:53 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:26:54.248150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-40b89a27-c092-4c3d-b3f1-74855f4efc39 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:54.248923 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-40b89a27-c092-4c3d-b3f1-74855f4efc39 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:54.255707 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40b89a27-c092-4c3d-b3f1-74855f4efc39 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:54.256180 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40b89a27-c092-4c3d-b3f1-74855f4efc39 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:54.256640 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40b89a27-c092-4c3d-b3f1-74855f4efc39 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:54.257397 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40b89a27-c092-4c3d-b3f1-74855f4efc39 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:54.257891 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40b89a27-c092-4c3d-b3f1-74855f4efc39 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:54.258371 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-40b89a27-c092-4c3d-b3f1-74855f4efc39 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:54.323896 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-40b89a27-c092-4c3d-b3f1-74855f4efc39 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:54.332101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-40b89a27-c092-4c3d-b3f1-74855f4efc39 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:54.333869 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-40b89a27-c092-4c3d-b3f1-74855f4efc39 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:54.335583 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-40b89a27-c092-4c3d-b3f1-74855f4efc39 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1341 microversion: 2.20 time: 0.091834 Aug 05 02:26:54.335583 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 408/817] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:26:54 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1341 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:26:54.932422 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-16cd203f-4229-4ae3-8538-94a7497abe4e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-502304730"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:54.933022 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-16cd203f-4229-4ae3-8538-94a7497abe4e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:54.938847 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16cd203f-4229-4ae3-8538-94a7497abe4e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:54.939327 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16cd203f-4229-4ae3-8538-94a7497abe4e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:54.939757 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16cd203f-4229-4ae3-8538-94a7497abe4e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:54.940480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16cd203f-4229-4ae3-8538-94a7497abe4e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:54.940931 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16cd203f-4229-4ae3-8538-94a7497abe4e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:54.941347 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16cd203f-4229-4ae3-8538-94a7497abe4e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:55.075842 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.network.security_group_api [None req-16cd203f-4229-4ae3-8538-94a7497abe4e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Removing security group 246e9fa9-513c-4d87-ba3e-6f6410a59cf3 from port 9017b9e3-fdca-4fff-a053-ec122ab62248 Aug 05 02:26:55.359837 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4b512aa1-6136-4627-a4ab-13fd3225f510 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:55.360504 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4b512aa1-6136-4627-a4ab-13fd3225f510 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:55.379833 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b512aa1-6136-4627-a4ab-13fd3225f510 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:55.380142 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b512aa1-6136-4627-a4ab-13fd3225f510 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:55.380597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b512aa1-6136-4627-a4ab-13fd3225f510 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:55.381470 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b512aa1-6136-4627-a4ab-13fd3225f510 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:55.382074 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b512aa1-6136-4627-a4ab-13fd3225f510 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:55.382645 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b512aa1-6136-4627-a4ab-13fd3225f510 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:55.427810 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-16cd203f-4229-4ae3-8538-94a7497abe4e tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "POST /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/action" status: 202 len: 0 microversion: 2.1 time: 0.605623 Aug 05 02:26:55.429008 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 410/818] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Aug 5 02:26:54 2022] POST /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:26:55.442497 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-5b6017f0-b685-4f62-bff5-7be793c3e7c2 req-cd6562b9-7532-4087-9e7b-a66516cc8a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c8e9d9-004f-4693-a78d-77027c30aede", "tag": "9017b9e3-fdca-4fff-a053-ec122ab62248"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:55.454036 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5b6017f0-b685-4f62-bff5-7be793c3e7c2 req-cd6562b9-7532-4087-9e7b-a66516cc8a97 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:55.454798 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5b6017f0-b685-4f62-bff5-7be793c3e7c2 req-cd6562b9-7532-4087-9e7b-a66516cc8a97 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:55.455741 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5b6017f0-b685-4f62-bff5-7be793c3e7c2 req-cd6562b9-7532-4087-9e7b-a66516cc8a97 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:55.467857 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-5b6017f0-b685-4f62-bff5-7be793c3e7c2 req-cd6562b9-7532-4087-9e7b-a66516cc8a97 service nova] Creating event network-changed:9017b9e3-fdca-4fff-a053-ec122ab62248 for instance d5c8e9d9-004f-4693-a78d-77027c30aede on hv-cinder-81558 Aug 05 02:26:55.473150 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-5b6017f0-b685-4f62-bff5-7be793c3e7c2 req-cd6562b9-7532-4087-9e7b-a66516cc8a97 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040455 Aug 05 02:26:55.473970 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 411/819] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:26:55.607579 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4b512aa1-6136-4627-a4ab-13fd3225f510 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:55.622507 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4b512aa1-6136-4627-a4ab-13fd3225f510 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:55.625535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4b512aa1-6136-4627-a4ab-13fd3225f510 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:55.630477 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4b512aa1-6136-4627-a4ab-13fd3225f510 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1407 microversion: 2.20 time: 0.272630 Aug 05 02:26:55.631986 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 409/820] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:26:55 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:26:56.099642 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-dabae8b2-6513-447f-8cb3-9a71d2d1c4ef req-bde89c7e-4619-45b4-8982-b5cd0954d2fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac84bba5-1a3a-4625-ad22-276df81d03a1", "tag": "a68b1751-4c77-41ca-80e7-300bcc5e2f50"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:56.111019 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-dabae8b2-6513-447f-8cb3-9a71d2d1c4ef req-bde89c7e-4619-45b4-8982-b5cd0954d2fb service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:56.111506 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-dabae8b2-6513-447f-8cb3-9a71d2d1c4ef req-bde89c7e-4619-45b4-8982-b5cd0954d2fb service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:56.111947 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-dabae8b2-6513-447f-8cb3-9a71d2d1c4ef req-bde89c7e-4619-45b4-8982-b5cd0954d2fb service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:56.124292 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-dabae8b2-6513-447f-8cb3-9a71d2d1c4ef req-bde89c7e-4619-45b4-8982-b5cd0954d2fb service nova] Creating event network-changed:a68b1751-4c77-41ca-80e7-300bcc5e2f50 for instance ac84bba5-1a3a-4625-ad22-276df81d03a1 on hv-cinder-81558 Aug 05 02:26:56.129733 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-dabae8b2-6513-447f-8cb3-9a71d2d1c4ef req-bde89c7e-4619-45b4-8982-b5cd0954d2fb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035929 Aug 05 02:26:56.130726 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 412/821] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:26:56.623390 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-50d15d7a-b15f-402f-bc7f-1a7c8b1df36b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:56.623910 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-50d15d7a-b15f-402f-bc7f-1a7c8b1df36b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:56.630876 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50d15d7a-b15f-402f-bc7f-1a7c8b1df36b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:56.631390 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50d15d7a-b15f-402f-bc7f-1a7c8b1df36b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:56.631827 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50d15d7a-b15f-402f-bc7f-1a7c8b1df36b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:56.632553 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50d15d7a-b15f-402f-bc7f-1a7c8b1df36b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:56.633011 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50d15d7a-b15f-402f-bc7f-1a7c8b1df36b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:56.633439 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50d15d7a-b15f-402f-bc7f-1a7c8b1df36b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:56.654726 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0023bf95-e0e1-4ae0-9b7e-bdd103aa18a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:56.656881 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0023bf95-e0e1-4ae0-9b7e-bdd103aa18a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:56.664311 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0023bf95-e0e1-4ae0-9b7e-bdd103aa18a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:56.665919 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0023bf95-e0e1-4ae0-9b7e-bdd103aa18a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:56.667539 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0023bf95-e0e1-4ae0-9b7e-bdd103aa18a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:56.668007 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0023bf95-e0e1-4ae0-9b7e-bdd103aa18a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:56.668607 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0023bf95-e0e1-4ae0-9b7e-bdd103aa18a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:56.669291 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0023bf95-e0e1-4ae0-9b7e-bdd103aa18a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:56.722785 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-50d15d7a-b15f-402f-bc7f-1a7c8b1df36b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lazy-loading 'services' on Instance uuid d5c8e9d9-004f-4693-a78d-77027c30aede {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:26:56.824294 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-50d15d7a-b15f-402f-bc7f-1a7c8b1df36b tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments/b41cafa0-942c-46c8-8a63-8abfb127c16e" status: 202 len: 0 microversion: 2.1 time: 0.205265 Aug 05 02:26:56.828758 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 410/822] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Aug 5 02:26:56 2022] DELETE /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments/b41cafa0-942c-46c8-8a63-8abfb127c16e => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:26:56.829970 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0023bf95-e0e1-4ae0-9b7e-bdd103aa18a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:56.835480 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6ff763ea-03cd-495e-b37e-36db81cc13ef tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:56.838949 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6ff763ea-03cd-495e-b37e-36db81cc13ef tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:56.842339 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0023bf95-e0e1-4ae0-9b7e-bdd103aa18a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:56.843961 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0023bf95-e0e1-4ae0-9b7e-bdd103aa18a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:56.845358 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0023bf95-e0e1-4ae0-9b7e-bdd103aa18a7 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1407 microversion: 2.20 time: 0.195871 Aug 05 02:26:56.846013 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 413/823] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:26:56 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:26:56.849348 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ff763ea-03cd-495e-b37e-36db81cc13ef tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:56.850009 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ff763ea-03cd-495e-b37e-36db81cc13ef tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:56.850600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ff763ea-03cd-495e-b37e-36db81cc13ef tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:56.851473 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ff763ea-03cd-495e-b37e-36db81cc13ef tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:56.851930 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ff763ea-03cd-495e-b37e-36db81cc13ef tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:56.852391 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6ff763ea-03cd-495e-b37e-36db81cc13ef tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:56.890519 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6ff763ea-03cd-495e-b37e-36db81cc13ef tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060235 Aug 05 02:26:56.891090 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 411/824] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:26:56 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:26:57.495358 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-9b8a6a45-f0e3-49b4-a7e1-301020a992be req-f1d0614d-fad9-435c-b35f-3eabd2a0fc73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c8e9d9-004f-4693-a78d-77027c30aede", "tag": "9017b9e3-fdca-4fff-a053-ec122ab62248"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:26:57.505964 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9b8a6a45-f0e3-49b4-a7e1-301020a992be req-f1d0614d-fad9-435c-b35f-3eabd2a0fc73 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:57.506440 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9b8a6a45-f0e3-49b4-a7e1-301020a992be req-f1d0614d-fad9-435c-b35f-3eabd2a0fc73 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:57.506868 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9b8a6a45-f0e3-49b4-a7e1-301020a992be req-f1d0614d-fad9-435c-b35f-3eabd2a0fc73 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:57.517961 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-9b8a6a45-f0e3-49b4-a7e1-301020a992be req-f1d0614d-fad9-435c-b35f-3eabd2a0fc73 service nova] Creating event network-changed:9017b9e3-fdca-4fff-a053-ec122ab62248 for instance d5c8e9d9-004f-4693-a78d-77027c30aede on hv-cinder-81558 Aug 05 02:26:57.522766 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-9b8a6a45-f0e3-49b4-a7e1-301020a992be req-f1d0614d-fad9-435c-b35f-3eabd2a0fc73 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031902 Aug 05 02:26:57.523540 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 414/825] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:26:57.868336 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5390d779-60ae-45db-99a3-fe74bc4d78f4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:57.869003 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5390d779-60ae-45db-99a3-fe74bc4d78f4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:57.875265 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5390d779-60ae-45db-99a3-fe74bc4d78f4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:57.875739 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5390d779-60ae-45db-99a3-fe74bc4d78f4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:57.876167 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5390d779-60ae-45db-99a3-fe74bc4d78f4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:57.876874 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5390d779-60ae-45db-99a3-fe74bc4d78f4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:57.877320 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5390d779-60ae-45db-99a3-fe74bc4d78f4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:57.877736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5390d779-60ae-45db-99a3-fe74bc4d78f4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:57.904409 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f867d637-e1a5-402b-b732-652aadcad77a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:57.906746 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f867d637-e1a5-402b-b732-652aadcad77a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:57.913341 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f867d637-e1a5-402b-b732-652aadcad77a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:57.913824 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f867d637-e1a5-402b-b732-652aadcad77a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:57.914257 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f867d637-e1a5-402b-b732-652aadcad77a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:57.914960 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f867d637-e1a5-402b-b732-652aadcad77a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:57.916041 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f867d637-e1a5-402b-b732-652aadcad77a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:57.916570 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f867d637-e1a5-402b-b732-652aadcad77a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:57.947803 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f867d637-e1a5-402b-b732-652aadcad77a tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048163 Aug 05 02:26:57.948417 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 415/826] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:26:57 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:26:58.161363 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5390d779-60ae-45db-99a3-fe74bc4d78f4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:58.169220 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5390d779-60ae-45db-99a3-fe74bc4d78f4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:58.170705 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5390d779-60ae-45db-99a3-fe74bc4d78f4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:58.171802 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5390d779-60ae-45db-99a3-fe74bc4d78f4 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1407 microversion: 2.20 time: 0.307369 Aug 05 02:26:58.172375 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 412/827] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:26:57 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:26:58.960467 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c5ae8bd3-c2b9-4258-a3f9-7c5cdba6bdf2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:58.962759 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c5ae8bd3-c2b9-4258-a3f9-7c5cdba6bdf2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:58.969335 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5ae8bd3-c2b9-4258-a3f9-7c5cdba6bdf2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:58.969812 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5ae8bd3-c2b9-4258-a3f9-7c5cdba6bdf2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:58.970242 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5ae8bd3-c2b9-4258-a3f9-7c5cdba6bdf2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:58.970920 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5ae8bd3-c2b9-4258-a3f9-7c5cdba6bdf2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:58.971366 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5ae8bd3-c2b9-4258-a3f9-7c5cdba6bdf2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:58.971786 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5ae8bd3-c2b9-4258-a3f9-7c5cdba6bdf2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:59.000507 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c5ae8bd3-c2b9-4258-a3f9-7c5cdba6bdf2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043940 Aug 05 02:26:59.001072 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 416/828] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:26:58 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:26:59.194322 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-87d8f8d3-3eef-4172-b336-ca78824707ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:26:59.194920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-87d8f8d3-3eef-4172-b336-ca78824707ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:26:59.201669 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-87d8f8d3-3eef-4172-b336-ca78824707ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:59.202150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-87d8f8d3-3eef-4172-b336-ca78824707ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:59.202581 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-87d8f8d3-3eef-4172-b336-ca78824707ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:59.203264 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-87d8f8d3-3eef-4172-b336-ca78824707ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:26:59.203712 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-87d8f8d3-3eef-4172-b336-ca78824707ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:26:59.204129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-87d8f8d3-3eef-4172-b336-ca78824707ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:26:59.332100 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-87d8f8d3-3eef-4172-b336-ca78824707ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:59.340773 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-87d8f8d3-3eef-4172-b336-ca78824707ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:59.342297 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-87d8f8d3-3eef-4172-b336-ca78824707ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:26:59.343390 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-87d8f8d3-3eef-4172-b336-ca78824707ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1407 microversion: 2.20 time: 0.152951 Aug 05 02:26:59.343940 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 413/829] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:26:59 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:27:00.013531 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5b7f4152-ad35-4a69-88ea-689e944c9b60 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:00.015674 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5b7f4152-ad35-4a69-88ea-689e944c9b60 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:00.021941 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b7f4152-ad35-4a69-88ea-689e944c9b60 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:00.022414 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b7f4152-ad35-4a69-88ea-689e944c9b60 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:00.022842 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b7f4152-ad35-4a69-88ea-689e944c9b60 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:00.023517 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b7f4152-ad35-4a69-88ea-689e944c9b60 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:00.023963 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b7f4152-ad35-4a69-88ea-689e944c9b60 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:00.024425 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b7f4152-ad35-4a69-88ea-689e944c9b60 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:00.055404 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5b7f4152-ad35-4a69-88ea-689e944c9b60 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046222 Aug 05 02:27:00.060469 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 417/830] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:27:00 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:27:00.365139 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-26b75339-a2cc-4a27-abaa-157d8da065ca tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:00.365742 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-26b75339-a2cc-4a27-abaa-157d8da065ca tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:00.372471 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-26b75339-a2cc-4a27-abaa-157d8da065ca tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:00.372952 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-26b75339-a2cc-4a27-abaa-157d8da065ca tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:00.373386 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-26b75339-a2cc-4a27-abaa-157d8da065ca tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:00.374086 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-26b75339-a2cc-4a27-abaa-157d8da065ca tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:00.374533 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-26b75339-a2cc-4a27-abaa-157d8da065ca tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:00.374955 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-26b75339-a2cc-4a27-abaa-157d8da065ca tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:00.900143 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-26b75339-a2cc-4a27-abaa-157d8da065ca tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:00.908296 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-26b75339-a2cc-4a27-abaa-157d8da065ca tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:00.909850 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-26b75339-a2cc-4a27-abaa-157d8da065ca tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:00.911029 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-26b75339-a2cc-4a27-abaa-157d8da065ca tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1407 microversion: 2.20 time: 0.549757 Aug 05 02:27:00.911595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 414/831] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:27:00 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1407 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:27:01.068835 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b3c92b5d-142a-40d1-b608-ebd5deb782e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:01.071029 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b3c92b5d-142a-40d1-b608-ebd5deb782e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:01.077761 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3c92b5d-142a-40d1-b608-ebd5deb782e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:01.078244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3c92b5d-142a-40d1-b608-ebd5deb782e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:01.078679 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3c92b5d-142a-40d1-b608-ebd5deb782e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:01.079395 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3c92b5d-142a-40d1-b608-ebd5deb782e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:01.079836 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3c92b5d-142a-40d1-b608-ebd5deb782e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:01.080262 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3c92b5d-142a-40d1-b608-ebd5deb782e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:01.112351 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b3c92b5d-142a-40d1-b608-ebd5deb782e8 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046919 Aug 05 02:27:01.112351 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 418/832] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:27:01 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 02:27:01.123058 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-95fb50d8-99f5-4eef-b25e-e3cbed115f7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:01.123560 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-95fb50d8-99f5-4eef-b25e-e3cbed115f7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:01.129376 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95fb50d8-99f5-4eef-b25e-e3cbed115f7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:01.129849 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95fb50d8-99f5-4eef-b25e-e3cbed115f7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:01.130274 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95fb50d8-99f5-4eef-b25e-e3cbed115f7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:01.130951 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95fb50d8-99f5-4eef-b25e-e3cbed115f7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:01.131401 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95fb50d8-99f5-4eef-b25e-e3cbed115f7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:01.131816 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-95fb50d8-99f5-4eef-b25e-e3cbed115f7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:01.205237 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-95fb50d8-99f5-4eef-b25e-e3cbed115f7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] HTTP exception thrown: Instance d5c8e9d9-004f-4693-a78d-77027c30aede is not attached to volume b41cafa0-942c-46c8-8a63-8abfb127c16e Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-95fb50d8-99f5-4eef-b25e-e3cbed115f7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Request method failure captured: Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments/b41cafa0-942c-46c8-8a63-8abfb127c16e HTTP/1.1 Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H6mb_PytLvoAKXlAFHtL4086PXOWzJlGre0DN_SnZV-a6V6kk9RdsLi1hzFblfTOVkdgoTO9db95LzhcrQ1oFe_uGPPJQtUlHkyj284-aejxYm9H5izHLuDB3ayay_HfRBD1hI5XEq1UbqnjvwnR6l8P7cp8JUYh_aZBfPVumfvQJI Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: a5d8a01fa4024794b4dde3beebbbd7f1 Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-TestMinimumBasicScenario-1045396866 Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:27:01.213225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:27:01.215046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a5d8a01fa4024794b4dde3beebbbd7f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a5d8a01fa4024794b4dde3beebbbd7f1", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a5d8a01fa4024794b4dde3beebbbd7f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a5d8a01fa4024794b4dde3beebbbd7f1"}]}] Aug 05 02:27:01.215046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-TestMinimumBasicScenario-1045396866 Aug 05 02:27:01.215046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: a5d8a01fa4024794b4dde3beebbbd7f1 Aug 05 02:27:01.215046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1045396866 Aug 05 02:27:01.215046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-TestMinimumBasicScenario-1045396866-project Aug 05 02:27:01.215046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:27:01.215046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:27:01.215046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 836dfe4afeef41ab86636b38cb9ccfc1 Aug 05 02:27:01.215046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-TestMinimumBasicScenario-1045396866-project Aug 05 02:27:01.215046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:27:01.215046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance d5c8e9d9-004f-4693-a78d-77027c30aede is not attached to volume b41cafa0-942c-46c8-8a63-8abfb127c16e Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'server_id': 'd5c8e9d9-004f-4693-a78d-77027c30aede', 'id': 'b41cafa0-942c-46c8-8a63-8abfb127c16e'} Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b41cafa0-942c-46c8-8a63-8abfb127c16e. Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:27:01.215845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:27:01.217129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:27:01.217129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 05 02:27:01.217129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 05 02:27:01.217129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c8e9d9-004f-4693-a78d-77027c30aede is not attached to volume b41cafa0-942c-46c8-8a63-8abfb127c16e Aug 05 02:27:01.217129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:27:01.217129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:27:01.217129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:27:01.217129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:01.217129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:27:01.217129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:27:01.217129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:27:01.217129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:27:01.217129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c8e9d9-004f-4693-a78d-77027c30aede is not attached to volume b41cafa0-942c-46c8-8a63-8abfb127c16e Aug 05 02:27:01.217129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:27:01.217129 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-95fb50d8-99f5-4eef-b25e-e3cbed115f7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Returning 404 to user: Instance d5c8e9d9-004f-4693-a78d-77027c30aede is not attached to volume b41cafa0-942c-46c8-8a63-8abfb127c16e {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:27:01.218150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-95fb50d8-99f5-4eef-b25e-e3cbed115f7d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments/b41cafa0-942c-46c8-8a63-8abfb127c16e" status: 404 len: 154 microversion: 2.1 time: 0.096096 Aug 05 02:27:01.218150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 415/833] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Aug 5 02:27:01 2022] DELETE /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede/os-volume_attachments/b41cafa0-942c-46c8-8a63-8abfb127c16e => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:27:01.935433 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-799c0cfe-bb3f-4e59-ad28-b01b590de8c2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:01.936038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-799c0cfe-bb3f-4e59-ad28-b01b590de8c2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:01.942004 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-799c0cfe-bb3f-4e59-ad28-b01b590de8c2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:01.942476 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-799c0cfe-bb3f-4e59-ad28-b01b590de8c2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:01.942904 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-799c0cfe-bb3f-4e59-ad28-b01b590de8c2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:01.943575 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-799c0cfe-bb3f-4e59-ad28-b01b590de8c2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:01.944019 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-799c0cfe-bb3f-4e59-ad28-b01b590de8c2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:01.944462 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-799c0cfe-bb3f-4e59-ad28-b01b590de8c2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:02.074515 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-799c0cfe-bb3f-4e59-ad28-b01b590de8c2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:02.082955 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-799c0cfe-bb3f-4e59-ad28-b01b590de8c2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:02.084456 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-799c0cfe-bb3f-4e59-ad28-b01b590de8c2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:02.085555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-799c0cfe-bb3f-4e59-ad28-b01b590de8c2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1407 microversion: 2.20 time: 0.154313 Aug 05 02:27:02.086101 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 419/834] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:27:01 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:27:02.357943 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bdd5b4ff-667e-4405-b08c-d10ba3c83ccd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:02.358607 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bdd5b4ff-667e-4405-b08c-d10ba3c83ccd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:02.365569 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bdd5b4ff-667e-4405-b08c-d10ba3c83ccd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:02.366052 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bdd5b4ff-667e-4405-b08c-d10ba3c83ccd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:02.366476 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bdd5b4ff-667e-4405-b08c-d10ba3c83ccd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:02.367182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bdd5b4ff-667e-4405-b08c-d10ba3c83ccd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:02.367628 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bdd5b4ff-667e-4405-b08c-d10ba3c83ccd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:02.368579 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bdd5b4ff-667e-4405-b08c-d10ba3c83ccd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:02.401268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bdd5b4ff-667e-4405-b08c-d10ba3c83ccd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:27:02.494429 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bdd5b4ff-667e-4405-b08c-d10ba3c83ccd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 204 len: 0 microversion: 2.1 time: 0.139987 Aug 05 02:27:02.495721 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 416/835] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:27:02 2022] DELETE /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:27:02.504774 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9516ada7-b99a-4eca-955b-0130525ed592 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:02.505446 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9516ada7-b99a-4eca-955b-0130525ed592 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:02.512427 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9516ada7-b99a-4eca-955b-0130525ed592 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:02.512913 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9516ada7-b99a-4eca-955b-0130525ed592 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:02.513351 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9516ada7-b99a-4eca-955b-0130525ed592 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:02.514044 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9516ada7-b99a-4eca-955b-0130525ed592 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:02.514509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9516ada7-b99a-4eca-955b-0130525ed592 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:02.514929 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9516ada7-b99a-4eca-955b-0130525ed592 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:02.651312 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9516ada7-b99a-4eca-955b-0130525ed592 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:02.659139 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9516ada7-b99a-4eca-955b-0130525ed592 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1553 microversion: 2.1 time: 0.158931 Aug 05 02:27:02.659697 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 420/836] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:02 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:03.109926 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0d0cf1c0-f965-4ee9-bc82-45c526b5b19d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:03.110525 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0d0cf1c0-f965-4ee9-bc82-45c526b5b19d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:03.112537 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:03.113341 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:03.119020 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d0cf1c0-f965-4ee9-bc82-45c526b5b19d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:03.119497 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d0cf1c0-f965-4ee9-bc82-45c526b5b19d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:03.119924 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d0cf1c0-f965-4ee9-bc82-45c526b5b19d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:03.120634 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d0cf1c0-f965-4ee9-bc82-45c526b5b19d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:03.121082 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d0cf1c0-f965-4ee9-bc82-45c526b5b19d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:03.121499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0d0cf1c0-f965-4ee9-bc82-45c526b5b19d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:03.255653 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0d0cf1c0-f965-4ee9-bc82-45c526b5b19d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:03.263714 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0d0cf1c0-f965-4ee9-bc82-45c526b5b19d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:03.265721 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0d0cf1c0-f965-4ee9-bc82-45c526b5b19d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:03.266334 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0d0cf1c0-f965-4ee9-bc82-45c526b5b19d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1407 microversion: 2.20 time: 0.160789 Aug 05 02:27:03.267001 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 417/837] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:27:03 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:27:03.682071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-157db480-1303-4d74-91be-b9b7b149d7bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:03.682685 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-157db480-1303-4d74-91be-b9b7b149d7bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:03.685154 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:03.690297 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-157db480-1303-4d74-91be-b9b7b149d7bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:03.690774 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-157db480-1303-4d74-91be-b9b7b149d7bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:03.691208 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-157db480-1303-4d74-91be-b9b7b149d7bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:03.691898 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-157db480-1303-4d74-91be-b9b7b149d7bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:03.692367 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-157db480-1303-4d74-91be-b9b7b149d7bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:03.692794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-157db480-1303-4d74-91be-b9b7b149d7bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:03.697743 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:03.822275 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-157db480-1303-4d74-91be-b9b7b149d7bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:03.829733 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-157db480-1303-4d74-91be-b9b7b149d7bf tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1553 microversion: 2.1 time: 0.151951 Aug 05 02:27:03.830299 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 421/838] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:03 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:04.289097 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6392da2a-7df9-4283-8e51-683b463eb474 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:04.289704 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6392da2a-7df9-4283-8e51-683b463eb474 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:04.296951 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6392da2a-7df9-4283-8e51-683b463eb474 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:04.297447 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6392da2a-7df9-4283-8e51-683b463eb474 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:04.297946 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6392da2a-7df9-4283-8e51-683b463eb474 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:04.298641 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6392da2a-7df9-4283-8e51-683b463eb474 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:04.299108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6392da2a-7df9-4283-8e51-683b463eb474 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:04.299521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6392da2a-7df9-4283-8e51-683b463eb474 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:04.311918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-677c204e-1c8d-4b99-8921-7360ac390cdd req-db0d5123-3199-451d-a3b0-e83cb0dc257c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac84bba5-1a3a-4625-ad22-276df81d03a1", "name": "network-vif-plugged", "status": "completed", "tag": "a68b1751-4c77-41ca-80e7-300bcc5e2f50"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:27:04.323393 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-677c204e-1c8d-4b99-8921-7360ac390cdd req-db0d5123-3199-451d-a3b0-e83cb0dc257c service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:04.323949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-677c204e-1c8d-4b99-8921-7360ac390cdd req-db0d5123-3199-451d-a3b0-e83cb0dc257c service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:04.324842 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-677c204e-1c8d-4b99-8921-7360ac390cdd req-db0d5123-3199-451d-a3b0-e83cb0dc257c service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:04.336167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-677c204e-1c8d-4b99-8921-7360ac390cdd req-db0d5123-3199-451d-a3b0-e83cb0dc257c service nova] Creating event network-vif-plugged:a68b1751-4c77-41ca-80e7-300bcc5e2f50 for instance ac84bba5-1a3a-4625-ad22-276df81d03a1 on hv-cinder-81558 Aug 05 02:27:04.341577 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-677c204e-1c8d-4b99-8921-7360ac390cdd req-db0d5123-3199-451d-a3b0-e83cb0dc257c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033271 Aug 05 02:27:04.342787 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 422/839] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:27:04.436685 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6392da2a-7df9-4283-8e51-683b463eb474 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:04.444551 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6392da2a-7df9-4283-8e51-683b463eb474 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:04.446115 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6392da2a-7df9-4283-8e51-683b463eb474 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:04.447771 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6392da2a-7df9-4283-8e51-683b463eb474 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1407 microversion: 2.20 time: 0.162696 Aug 05 02:27:04.448368 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 418/840] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:27:04 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:27:04.851896 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a17bddb3-354a-4464-89fe-918bb625217d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:04.853383 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a17bddb3-354a-4464-89fe-918bb625217d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:04.860107 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a17bddb3-354a-4464-89fe-918bb625217d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:04.860615 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a17bddb3-354a-4464-89fe-918bb625217d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:04.861047 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a17bddb3-354a-4464-89fe-918bb625217d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:04.861737 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a17bddb3-354a-4464-89fe-918bb625217d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:04.862183 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a17bddb3-354a-4464-89fe-918bb625217d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:04.862709 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a17bddb3-354a-4464-89fe-918bb625217d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:04.998984 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a17bddb3-354a-4464-89fe-918bb625217d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:05.006414 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a17bddb3-354a-4464-89fe-918bb625217d tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1553 microversion: 2.1 time: 0.158638 Aug 05 02:27:05.006986 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 423/841] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:04 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:05.379240 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-26050831-e5c2-4467-92b3-fd9bea366be4 req-6e94f8d0-dbd3-414b-be4a-bdc3053b5272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c8e9d9-004f-4693-a78d-77027c30aede", "name": "network-vif-deleted", "tag": "9017b9e3-fdca-4fff-a053-ec122ab62248"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:27:05.390179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-26050831-e5c2-4467-92b3-fd9bea366be4 req-6e94f8d0-dbd3-414b-be4a-bdc3053b5272 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:05.390649 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-26050831-e5c2-4467-92b3-fd9bea366be4 req-6e94f8d0-dbd3-414b-be4a-bdc3053b5272 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:05.391082 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-26050831-e5c2-4467-92b3-fd9bea366be4 req-6e94f8d0-dbd3-414b-be4a-bdc3053b5272 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:05.402322 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-26050831-e5c2-4467-92b3-fd9bea366be4 req-6e94f8d0-dbd3-414b-be4a-bdc3053b5272 service nova] Creating event network-vif-deleted:9017b9e3-fdca-4fff-a053-ec122ab62248 for instance d5c8e9d9-004f-4693-a78d-77027c30aede on hv-cinder-81558 Aug 05 02:27:05.406914 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-26050831-e5c2-4467-92b3-fd9bea366be4 req-6e94f8d0-dbd3-414b-be4a-bdc3053b5272 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031340 Aug 05 02:27:05.407472 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 419/842] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:27:05.470311 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3becf3c1-1c42-42d1-aa4b-2b683b7ded55 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:05.471050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3becf3c1-1c42-42d1-aa4b-2b683b7ded55 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:05.477101 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3becf3c1-1c42-42d1-aa4b-2b683b7ded55 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:05.477952 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3becf3c1-1c42-42d1-aa4b-2b683b7ded55 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:05.478403 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3becf3c1-1c42-42d1-aa4b-2b683b7ded55 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:05.479088 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3becf3c1-1c42-42d1-aa4b-2b683b7ded55 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:05.479536 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3becf3c1-1c42-42d1-aa4b-2b683b7ded55 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:05.479956 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3becf3c1-1c42-42d1-aa4b-2b683b7ded55 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:05.608482 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3becf3c1-1c42-42d1-aa4b-2b683b7ded55 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:05.618364 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3becf3c1-1c42-42d1-aa4b-2b683b7ded55 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:05.620141 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3becf3c1-1c42-42d1-aa4b-2b683b7ded55 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:05.621278 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3becf3c1-1c42-42d1-aa4b-2b683b7ded55 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1407 microversion: 2.20 time: 0.155114 Aug 05 02:27:05.621838 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 424/843] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:27:05 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:27:06.029451 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b836499f-823e-4af7-abba-268bcdd486c2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:06.030133 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b836499f-823e-4af7-abba-268bcdd486c2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:06.036109 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b836499f-823e-4af7-abba-268bcdd486c2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:06.036611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b836499f-823e-4af7-abba-268bcdd486c2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:06.037042 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b836499f-823e-4af7-abba-268bcdd486c2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:06.037717 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b836499f-823e-4af7-abba-268bcdd486c2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:06.038163 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b836499f-823e-4af7-abba-268bcdd486c2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:06.038584 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b836499f-823e-4af7-abba-268bcdd486c2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:06.056788 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:06.106390 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b836499f-823e-4af7-abba-268bcdd486c2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:06.113997 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b836499f-823e-4af7-abba-268bcdd486c2 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1343 microversion: 2.1 time: 0.089734 Aug 05 02:27:06.114594 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 420/844] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:06 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1343 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:06.644144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-143d2acd-86f9-40c0-89f8-399f8e627dac tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:06.644764 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-143d2acd-86f9-40c0-89f8-399f8e627dac tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:06.651798 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-143d2acd-86f9-40c0-89f8-399f8e627dac tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:06.652278 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-143d2acd-86f9-40c0-89f8-399f8e627dac tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:06.652735 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-143d2acd-86f9-40c0-89f8-399f8e627dac tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:06.653451 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-143d2acd-86f9-40c0-89f8-399f8e627dac tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:06.653898 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-143d2acd-86f9-40c0-89f8-399f8e627dac tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:06.654315 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-143d2acd-86f9-40c0-89f8-399f8e627dac tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:06.801192 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-143d2acd-86f9-40c0-89f8-399f8e627dac tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:06.810097 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-143d2acd-86f9-40c0-89f8-399f8e627dac tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:06.811591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-143d2acd-86f9-40c0-89f8-399f8e627dac tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:06.812749 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-143d2acd-86f9-40c0-89f8-399f8e627dac tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1407 microversion: 2.20 time: 0.172423 Aug 05 02:27:06.813294 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 425/845] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:27:06 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:27:07.136162 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d2603056-03be-4676-a1b1-ef2f50f84879 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:07.136782 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d2603056-03be-4676-a1b1-ef2f50f84879 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:07.143131 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2603056-03be-4676-a1b1-ef2f50f84879 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:07.143601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2603056-03be-4676-a1b1-ef2f50f84879 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:07.144027 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2603056-03be-4676-a1b1-ef2f50f84879 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:07.144726 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2603056-03be-4676-a1b1-ef2f50f84879 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:07.145172 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2603056-03be-4676-a1b1-ef2f50f84879 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:07.145586 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2603056-03be-4676-a1b1-ef2f50f84879 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:07.176223 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2603056-03be-4676-a1b1-ef2f50f84879 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:07.176724 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2603056-03be-4676-a1b1-ef2f50f84879 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:07.177150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d2603056-03be-4676-a1b1-ef2f50f84879 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:07.177586 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-d2603056-03be-4676-a1b1-ef2f50f84879 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lazy-loading 'fault' on Instance uuid d5c8e9d9-004f-4693-a78d-77027c30aede {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:27:07.218785 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d2603056-03be-4676-a1b1-ef2f50f84879 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836dfe4afeef41ab86636b38cb9ccfc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:07.226820 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d2603056-03be-4676-a1b1-ef2f50f84879 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 200 len: 1348 microversion: 2.1 time: 0.095127 Aug 05 02:27:07.232365 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 421/846] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:07 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:07.834979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6a51d999-4355-43da-8cf0-75d8a36d827e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:07.835586 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6a51d999-4355-43da-8cf0-75d8a36d827e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:07.838101 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:07.844287 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a51d999-4355-43da-8cf0-75d8a36d827e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:07.844808 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a51d999-4355-43da-8cf0-75d8a36d827e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:07.845233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a51d999-4355-43da-8cf0-75d8a36d827e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:07.845957 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a51d999-4355-43da-8cf0-75d8a36d827e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:07.846405 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a51d999-4355-43da-8cf0-75d8a36d827e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:07.846820 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6a51d999-4355-43da-8cf0-75d8a36d827e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:07.979306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6a51d999-4355-43da-8cf0-75d8a36d827e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:07.987212 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6a51d999-4355-43da-8cf0-75d8a36d827e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:07.988744 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6a51d999-4355-43da-8cf0-75d8a36d827e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:07.989890 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6a51d999-4355-43da-8cf0-75d8a36d827e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1598 microversion: 2.20 time: 0.158793 Aug 05 02:27:07.990452 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 426/847] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:27:07 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:27:08.012264 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-25d37929-bd4e-4a26-8a31-eaf00f3392b0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:08.012796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-25d37929-bd4e-4a26-8a31-eaf00f3392b0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:08.018703 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25d37929-bd4e-4a26-8a31-eaf00f3392b0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:08.019188 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25d37929-bd4e-4a26-8a31-eaf00f3392b0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:08.019791 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25d37929-bd4e-4a26-8a31-eaf00f3392b0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:08.020666 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25d37929-bd4e-4a26-8a31-eaf00f3392b0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:08.021127 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25d37929-bd4e-4a26-8a31-eaf00f3392b0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:08.021554 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-25d37929-bd4e-4a26-8a31-eaf00f3392b0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:08.097546 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-25d37929-bd4e-4a26-8a31-eaf00f3392b0 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089401 Aug 05 02:27:08.098161 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 422/848] 10.222.0.15 () {60 vars in 1316 bytes} [Fri Aug 5 02:27:08 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 05 02:27:08.249586 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-23f00da2-5164-4f7e-9fdc-e068441fbbfd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:08.250203 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-23f00da2-5164-4f7e-9fdc-e068441fbbfd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] [instance: d5c8e9d9-004f-4693-a78d-77027c30aede] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:08.256623 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23f00da2-5164-4f7e-9fdc-e068441fbbfd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:08.257133 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23f00da2-5164-4f7e-9fdc-e068441fbbfd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:08.257563 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23f00da2-5164-4f7e-9fdc-e068441fbbfd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:08.258329 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23f00da2-5164-4f7e-9fdc-e068441fbbfd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:08.258804 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23f00da2-5164-4f7e-9fdc-e068441fbbfd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:08.259173 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23f00da2-5164-4f7e-9fdc-e068441fbbfd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:08.275893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-23f00da2-5164-4f7e-9fdc-e068441fbbfd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] HTTP exception thrown: Instance d5c8e9d9-004f-4693-a78d-77027c30aede could not be found. Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-23f00da2-5164-4f7e-9fdc-e068441fbbfd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Request method failure captured: Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede HTTP/1.1 Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H6mb_PytLvoAKXlAFHtL4086PXOWzJlGre0DN_SnZV-a6V6kk9RdsLi1hzFblfTOVkdgoTO9db95LzhcrQ1oFe_uGPPJQtUlHkyj284-aejxYm9H5izHLuDB3ayay_HfRBD1hI5XEq1UbqnjvwnR6l8P7cp8JUYh_aZBfPVumfvQJI Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: a5d8a01fa4024794b4dde3beebbbd7f1 Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestMinimumBasicScenario-1045396866 Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:27:08.277732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:27:08.279229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a5d8a01fa4024794b4dde3beebbbd7f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a5d8a01fa4024794b4dde3beebbbd7f1", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a5d8a01fa4024794b4dde3beebbbd7f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a5d8a01fa4024794b4dde3beebbbd7f1"}]}] Aug 05 02:27:08.279229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestMinimumBasicScenario-1045396866 Aug 05 02:27:08.279229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: a5d8a01fa4024794b4dde3beebbbd7f1 Aug 05 02:27:08.279229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1045396866 Aug 05 02:27:08.279229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-TestMinimumBasicScenario-1045396866-project Aug 05 02:27:08.279229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:27:08.279229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:27:08.279229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 836dfe4afeef41ab86636b38cb9ccfc1 Aug 05 02:27:08.279229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestMinimumBasicScenario-1045396866-project Aug 05 02:27:08.279229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:27:08.279229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance d5c8e9d9-004f-4693-a78d-77027c30aede could not be found. Aug 05 02:27:08.279229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': 'd5c8e9d9-004f-4693-a78d-77027c30aede'} Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c8e9d9-004f-4693-a78d-77027c30aede could not be found. Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:27:08.279979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c8e9d9-004f-4693-a78d-77027c30aede could not be found. Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c8e9d9-004f-4693-a78d-77027c30aede could not be found. Aug 05 02:27:08.281252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:08.282357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-23f00da2-5164-4f7e-9fdc-e068441fbbfd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Returning 404 to user: Instance d5c8e9d9-004f-4693-a78d-77027c30aede could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:27:08.282357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-23f00da2-5164-4f7e-9fdc-e068441fbbfd tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede" status: 404 len: 111 microversion: 2.1 time: 0.033484 Aug 05 02:27:08.282357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 427/849] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:08 2022] GET /compute/v2.1/servers/d5c8e9d9-004f-4693-a78d-77027c30aede => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:27:08.288618 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-83cfa450-9295-437d-a02a-a95d0e76fab3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] Calling method '.version_select at 0x7fa65c5599d0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:08.308898 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-83cfa450-9295-437d-a02a-a95d0e76fab3 tempest-TestMinimumBasicScenario-1045396866 tempest-TestMinimumBasicScenario-1045396866-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1049348527" status: 202 len: 0 microversion: 2.1 time: 0.024504 Aug 05 02:27:08.309702 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 423/850] 10.222.0.15 () {58 vars in 1272 bytes} [Fri Aug 5 02:27:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1049348527 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:27:09.316061 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-f6a4b28e-6162-4509-bce7-e503bfbe782c req-4fcc3a84-6363-4968-b4c8-ebfbeffafbdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac84bba5-1a3a-4625-ad22-276df81d03a1", "tag": "a68b1751-4c77-41ca-80e7-300bcc5e2f50"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:27:09.326887 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f6a4b28e-6162-4509-bce7-e503bfbe782c req-4fcc3a84-6363-4968-b4c8-ebfbeffafbdd service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:09.327367 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f6a4b28e-6162-4509-bce7-e503bfbe782c req-4fcc3a84-6363-4968-b4c8-ebfbeffafbdd service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:09.327802 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f6a4b28e-6162-4509-bce7-e503bfbe782c req-4fcc3a84-6363-4968-b4c8-ebfbeffafbdd service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:09.339947 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-f6a4b28e-6162-4509-bce7-e503bfbe782c req-4fcc3a84-6363-4968-b4c8-ebfbeffafbdd service nova] Creating event network-changed:a68b1751-4c77-41ca-80e7-300bcc5e2f50 for instance ac84bba5-1a3a-4625-ad22-276df81d03a1 on hv-cinder-81558 Aug 05 02:27:09.344992 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-f6a4b28e-6162-4509-bce7-e503bfbe782c req-4fcc3a84-6363-4968-b4c8-ebfbeffafbdd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032546 Aug 05 02:27:09.345786 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 428/851] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:27:19.433932 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2899f704-d862-45e6-8524-ff0bf4b43140 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:19.436417 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2899f704-d862-45e6-8524-ff0bf4b43140 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:19.438775 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=14 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:19.439664 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:19.448526 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2899f704-d862-45e6-8524-ff0bf4b43140 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:19.449163 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2899f704-d862-45e6-8524-ff0bf4b43140 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:19.449735 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2899f704-d862-45e6-8524-ff0bf4b43140 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:19.450561 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2899f704-d862-45e6-8524-ff0bf4b43140 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:19.451099 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2899f704-d862-45e6-8524-ff0bf4b43140 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:19.451728 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2899f704-d862-45e6-8524-ff0bf4b43140 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:19.499711 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2899f704-d862-45e6-8524-ff0bf4b43140 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069372 Aug 05 02:27:19.499711 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 424/852] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:27:19 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 02:27:19.590955 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=5 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:19.591722 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=34 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:19.597140 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e5416300-f5d6-48c2-8fb0-d8d8ef17fc44 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:19.597767 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e5416300-f5d6-48c2-8fb0-d8d8ef17fc44 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:19.615122 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5416300-f5d6-48c2-8fb0-d8d8ef17fc44 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:19.615921 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5416300-f5d6-48c2-8fb0-d8d8ef17fc44 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:19.616602 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5416300-f5d6-48c2-8fb0-d8d8ef17fc44 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:19.617998 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5416300-f5d6-48c2-8fb0-d8d8ef17fc44 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:19.618610 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5416300-f5d6-48c2-8fb0-d8d8ef17fc44 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:19.619190 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5416300-f5d6-48c2-8fb0-d8d8ef17fc44 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:19.661466 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e5416300-f5d6-48c2-8fb0-d8d8ef17fc44 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:27:19.797954 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e5416300-f5d6-48c2-8fb0-d8d8ef17fc44 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 204 len: 0 microversion: 2.1 time: 0.209632 Aug 05 02:27:19.798951 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 429/853] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:27:19 2022] DELETE /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:27:19.807986 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ece18fb5-437a-477e-8428-8c21fe597798 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:19.808931 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ece18fb5-437a-477e-8428-8c21fe597798 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:19.815326 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ece18fb5-437a-477e-8428-8c21fe597798 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:19.816053 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ece18fb5-437a-477e-8428-8c21fe597798 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:19.816758 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ece18fb5-437a-477e-8428-8c21fe597798 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:19.817658 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ece18fb5-437a-477e-8428-8c21fe597798 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:19.818299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ece18fb5-437a-477e-8428-8c21fe597798 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:19.818910 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ece18fb5-437a-477e-8428-8c21fe597798 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:19.991136 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ece18fb5-437a-477e-8428-8c21fe597798 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:19.999312 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ece18fb5-437a-477e-8428-8c21fe597798 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1671 microversion: 2.1 time: 0.196012 Aug 05 02:27:20.000544 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 425/854] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:19 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1671 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:27:21.021574 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dca440a1-32a0-442b-b9af-31c1d210e22a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:21.022276 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dca440a1-32a0-442b-b9af-31c1d210e22a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:21.032311 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dca440a1-32a0-442b-b9af-31c1d210e22a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:21.033324 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dca440a1-32a0-442b-b9af-31c1d210e22a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:21.034535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dca440a1-32a0-442b-b9af-31c1d210e22a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:21.035463 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dca440a1-32a0-442b-b9af-31c1d210e22a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:21.036042 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dca440a1-32a0-442b-b9af-31c1d210e22a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:21.037228 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dca440a1-32a0-442b-b9af-31c1d210e22a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:21.264763 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dca440a1-32a0-442b-b9af-31c1d210e22a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:21.275672 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dca440a1-32a0-442b-b9af-31c1d210e22a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1671 microversion: 2.1 time: 0.258359 Aug 05 02:27:21.276258 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 430/855] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:21 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1671 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:21.624694 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1e3d2076-c313-4cb7-b330-716fe8566e3c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:21.625337 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1e3d2076-c313-4cb7-b330-716fe8566e3c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:21.634986 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e3d2076-c313-4cb7-b330-716fe8566e3c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:21.635490 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e3d2076-c313-4cb7-b330-716fe8566e3c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:21.635988 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e3d2076-c313-4cb7-b330-716fe8566e3c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:21.636947 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e3d2076-c313-4cb7-b330-716fe8566e3c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:21.637448 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e3d2076-c313-4cb7-b330-716fe8566e3c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:21.637953 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1e3d2076-c313-4cb7-b330-716fe8566e3c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:21.757462 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-1e3d2076-c313-4cb7-b330-716fe8566e3c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lazy-loading 'services' on Instance uuid 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:27:21.845251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1e3d2076-c313-4cb7-b330-716fe8566e3c tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "DELETE /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-volume_attachments/f9048f0f-0033-41ff-aa66-8f255f6704ff" status: 202 len: 0 microversion: 2.1 time: 0.224459 Aug 05 02:27:21.845894 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 426/856] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Aug 5 02:27:21 2022] DELETE /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-volume_attachments/f9048f0f-0033-41ff-aa66-8f255f6704ff => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 02:27:21.854710 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-85c6178e-d3fb-4a34-b852-399d1011c319 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:21.856891 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-85c6178e-d3fb-4a34-b852-399d1011c319 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:21.863699 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85c6178e-d3fb-4a34-b852-399d1011c319 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:21.864192 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85c6178e-d3fb-4a34-b852-399d1011c319 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:21.864657 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85c6178e-d3fb-4a34-b852-399d1011c319 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:21.865445 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85c6178e-d3fb-4a34-b852-399d1011c319 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:21.865902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85c6178e-d3fb-4a34-b852-399d1011c319 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:21.866325 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85c6178e-d3fb-4a34-b852-399d1011c319 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:21.913403 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-85c6178e-d3fb-4a34-b852-399d1011c319 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062940 Aug 05 02:27:21.920046 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 431/857] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:27:21 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:27:22.296751 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a699d169-ef82-47a6-96f3-5f1b853eeb61 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:22.297742 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a699d169-ef82-47a6-96f3-5f1b853eeb61 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:22.304198 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a699d169-ef82-47a6-96f3-5f1b853eeb61 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:22.306460 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a699d169-ef82-47a6-96f3-5f1b853eeb61 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:22.308152 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a699d169-ef82-47a6-96f3-5f1b853eeb61 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:22.310292 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a699d169-ef82-47a6-96f3-5f1b853eeb61 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:22.310956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a699d169-ef82-47a6-96f3-5f1b853eeb61 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:22.311595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a699d169-ef82-47a6-96f3-5f1b853eeb61 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:22.344765 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-abcf89c8-860a-4d70-889f-93ada270da0b req-ea2d0e15-4b08-412a-85dc-3699f7d5c8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d325dc2e-780c-41fe-bdad-ac41805f3534", "name": "network-vif-deleted", "tag": "c3c4ea12-20f0-402c-a002-d09aebd27024"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:27:22.356149 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-abcf89c8-860a-4d70-889f-93ada270da0b req-ea2d0e15-4b08-412a-85dc-3699f7d5c8c9 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:22.356689 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-abcf89c8-860a-4d70-889f-93ada270da0b req-ea2d0e15-4b08-412a-85dc-3699f7d5c8c9 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:22.357111 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-abcf89c8-860a-4d70-889f-93ada270da0b req-ea2d0e15-4b08-412a-85dc-3699f7d5c8c9 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:22.375720 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-abcf89c8-860a-4d70-889f-93ada270da0b req-ea2d0e15-4b08-412a-85dc-3699f7d5c8c9 service nova] Creating event network-vif-deleted:c3c4ea12-20f0-402c-a002-d09aebd27024 for instance d325dc2e-780c-41fe-bdad-ac41805f3534 on hv-cinder-81558 Aug 05 02:27:22.393678 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-abcf89c8-860a-4d70-889f-93ada270da0b req-ea2d0e15-4b08-412a-85dc-3699f7d5c8c9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052913 Aug 05 02:27:22.406884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 432/858] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:27:22.441725 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a699d169-ef82-47a6-96f3-5f1b853eeb61 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:22.451501 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a699d169-ef82-47a6-96f3-5f1b853eeb61 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 200 len: 1604 microversion: 2.1 time: 0.158846 Aug 05 02:27:22.452085 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 427/859] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:22 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 1604 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:22.926767 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-90f30e9b-4da2-4d27-8b68-a85fb7b724eb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:22.929124 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-90f30e9b-4da2-4d27-8b68-a85fb7b724eb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:22.944797 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90f30e9b-4da2-4d27-8b68-a85fb7b724eb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:22.945553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90f30e9b-4da2-4d27-8b68-a85fb7b724eb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:22.946150 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90f30e9b-4da2-4d27-8b68-a85fb7b724eb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:22.947061 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90f30e9b-4da2-4d27-8b68-a85fb7b724eb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:22.947680 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90f30e9b-4da2-4d27-8b68-a85fb7b724eb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:22.948261 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-90f30e9b-4da2-4d27-8b68-a85fb7b724eb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:22.997099 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-90f30e9b-4da2-4d27-8b68-a85fb7b724eb tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074619 Aug 05 02:27:22.999227 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 433/860] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:27:22 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:27:23.477243 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e4a25978-89dc-4e0b-99e5-7b92be307942 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:23.478727 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e4a25978-89dc-4e0b-99e5-7b92be307942 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:23.486671 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4a25978-89dc-4e0b-99e5-7b92be307942 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:23.487513 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4a25978-89dc-4e0b-99e5-7b92be307942 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:23.488357 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4a25978-89dc-4e0b-99e5-7b92be307942 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:23.489539 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4a25978-89dc-4e0b-99e5-7b92be307942 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:23.490239 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4a25978-89dc-4e0b-99e5-7b92be307942 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:23.490899 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e4a25978-89dc-4e0b-99e5-7b92be307942 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:23.506399 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-e4a25978-89dc-4e0b-99e5-7b92be307942 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] HTTP exception thrown: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e4a25978-89dc-4e0b-99e5-7b92be307942 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Request method failure captured: Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 HTTP/1.1 Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5s3hQ3kOD4WL2KLqkoL_gM9AiYc1ydK9E-n2GYq7YFgrz6PJ9tbrfP-t6_AeSzxJDNjui5X0ojaQfeWudUidxPRgNDn48WNDqh4Bx-R1lfWxWwF_LHW6lg4dlcfZwXEyzeThRS2pimTzks3HnbgIGQ9XyUWDhVrOsg2GKYQVE7QBw Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: ce1ac0db26e648bba79191b3ad8a260b Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:27:23.509382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:27:23.510757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ce1ac0db26e648bba79191b3ad8a260b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ce1ac0db26e648bba79191b3ad8a260b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce1ac0db26e648bba79191b3ad8a260b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce1ac0db26e648bba79191b3ad8a260b"}]}] Aug 05 02:27:23.510757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:27:23.510757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: ce1ac0db26e648bba79191b3ad8a260b Aug 05 02:27:23.510757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:27:23.510757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeTestJSON-628550396-project Aug 05 02:27:23.510757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:27:23.510757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:27:23.510757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 64280d0c3da14f329b6fc21228d92288 Aug 05 02:27:23.510757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeTestJSON-628550396-project Aug 05 02:27:23.510757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:27:23.510757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. Aug 05 02:27:23.510757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': 'd325dc2e-780c-41fe-bdad-ac41805f3534'} Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:27:23.511535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. Aug 05 02:27:23.512846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:27:23.515501 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e4a25978-89dc-4e0b-99e5-7b92be307942 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Returning 404 to user: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:27:23.516643 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e4a25978-89dc-4e0b-99e5-7b92be307942 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 404 len: 111 microversion: 2.1 time: 0.043484 Aug 05 02:27:23.521306 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 428/861] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:23 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:27:23.529943 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-522b1144-6d92-47e4-9b8a-1947521be9f1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '.version_select at 0x7fa65c63e280>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:23.565304 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-522b1144-6d92-47e4-9b8a-1947521be9f1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-319549946" status: 202 len: 0 microversion: 2.1 time: 0.042264 Aug 05 02:27:23.567605 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 434/862] 10.222.0.15 () {58 vars in 1218 bytes} [Fri Aug 5 02:27:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-319549946 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:27:24.010891 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ef332b22-906a-4093-afa5-7f5ef3139796 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:24.015256 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ef332b22-906a-4093-afa5-7f5ef3139796 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:24.027992 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef332b22-906a-4093-afa5-7f5ef3139796 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:24.030891 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef332b22-906a-4093-afa5-7f5ef3139796 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:24.031600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef332b22-906a-4093-afa5-7f5ef3139796 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:24.032571 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef332b22-906a-4093-afa5-7f5ef3139796 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:24.035322 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef332b22-906a-4093-afa5-7f5ef3139796 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:24.035769 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ef332b22-906a-4093-afa5-7f5ef3139796 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:24.071137 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ef332b22-906a-4093-afa5-7f5ef3139796 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064163 Aug 05 02:27:24.073194 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 429/863] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:27:24 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 02:27:24.187625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-df875029-91db-4510-a06c-6dd97c3168d5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:24.188127 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-df875029-91db-4510-a06c-6dd97c3168d5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:24.209809 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df875029-91db-4510-a06c-6dd97c3168d5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:24.210429 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df875029-91db-4510-a06c-6dd97c3168d5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:24.211681 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df875029-91db-4510-a06c-6dd97c3168d5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:24.217113 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df875029-91db-4510-a06c-6dd97c3168d5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:24.217808 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df875029-91db-4510-a06c-6dd97c3168d5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:24.219185 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df875029-91db-4510-a06c-6dd97c3168d5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:24.265661 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-df875029-91db-4510-a06c-6dd97c3168d5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:27:24.458197 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-df875029-91db-4510-a06c-6dd97c3168d5 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "DELETE /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 204 len: 0 microversion: 2.1 time: 0.272606 Aug 05 02:27:24.460358 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 435/864] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:27:24 2022] DELETE /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 02:27:24.481182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-899fccdd-bea1-44ad-b9a0-d58de7e0fced tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:24.481988 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-899fccdd-bea1-44ad-b9a0-d58de7e0fced tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:24.490613 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-899fccdd-bea1-44ad-b9a0-d58de7e0fced tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:24.491631 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-899fccdd-bea1-44ad-b9a0-d58de7e0fced tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:24.492958 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-899fccdd-bea1-44ad-b9a0-d58de7e0fced tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:24.493842 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-899fccdd-bea1-44ad-b9a0-d58de7e0fced tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:24.494594 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-899fccdd-bea1-44ad-b9a0-d58de7e0fced tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:24.495209 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-899fccdd-bea1-44ad-b9a0-d58de7e0fced tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:24.808217 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-899fccdd-bea1-44ad-b9a0-d58de7e0fced tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:24.820314 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-899fccdd-bea1-44ad-b9a0-d58de7e0fced tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1689 microversion: 2.1 time: 0.352144 Aug 05 02:27:24.845731 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 430/865] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:24 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1689 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:25.035338 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-135cc64f-57fc-4ea1-9205-290ed9d2aafe tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Action: 'create', calling method: .version_select at 0x7fa65c606160>, body: {"keypair": {"name": "tempest-keypair-1094181975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHuQRhxgG9jUwxJsG5l0hN/D6bBdfHvC8quRFJxOLLipnK0XpBASh5LPIukevJMIfymiAAQCCQAPXLrCbPlVxLdvChw1Pg2qrEmKJ/EpKVRRih5MjMujynfXlkDGXRGaw=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:27:25.052656 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-135cc64f-57fc-4ea1-9205-290ed9d2aafe tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Getting quotas for project ce1ac0db26e648bba79191b3ad8a260b. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:27:25.060653 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-135cc64f-57fc-4ea1-9205-290ed9d2aafe tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Getting quotas for user 64280d0c3da14f329b6fc21228d92288 and project ce1ac0db26e648bba79191b3ad8a260b. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:27:25.088817 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-135cc64f-57fc-4ea1-9205-290ed9d2aafe tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057614 Aug 05 02:27:25.089482 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 436/866] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Aug 5 02:27:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:27:25.843373 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8aef416f-23b8-48ab-a826-83cd31ac7662 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:25.844584 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8aef416f-23b8-48ab-a826-83cd31ac7662 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:25.856743 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8aef416f-23b8-48ab-a826-83cd31ac7662 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:25.858474 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8aef416f-23b8-48ab-a826-83cd31ac7662 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:25.863902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8aef416f-23b8-48ab-a826-83cd31ac7662 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:25.864855 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8aef416f-23b8-48ab-a826-83cd31ac7662 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:25.865349 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8aef416f-23b8-48ab-a826-83cd31ac7662 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:25.865827 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8aef416f-23b8-48ab-a826-83cd31ac7662 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:26.216130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8aef416f-23b8-48ab-a826-83cd31ac7662 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:26.225733 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8aef416f-23b8-48ab-a826-83cd31ac7662 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1689 microversion: 2.1 time: 0.386381 Aug 05 02:27:26.227289 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 431/867] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:25 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1689 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:27:27.252095 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-61a9ef99-a2e6-46b4-a06d-c7a386ddd158 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:27.253086 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-61a9ef99-a2e6-46b4-a06d-c7a386ddd158 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:27.262274 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-61a9ef99-a2e6-46b4-a06d-c7a386ddd158 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:27.262984 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-61a9ef99-a2e6-46b4-a06d-c7a386ddd158 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:27.263418 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-61a9ef99-a2e6-46b4-a06d-c7a386ddd158 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:27.264238 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-61a9ef99-a2e6-46b4-a06d-c7a386ddd158 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:27.264719 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-61a9ef99-a2e6-46b4-a06d-c7a386ddd158 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:27.265300 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-61a9ef99-a2e6-46b4-a06d-c7a386ddd158 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:27.277347 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1428338182", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf7849d5-61da-44b5-8e65-8d7323d12692"}], "security_groups": [{"name": "tempest-securitygroup--1965419859"}], "key_name": "tempest-keypair-1094181975", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:27:27.427373 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-61a9ef99-a2e6-46b4-a06d-c7a386ddd158 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:27.436411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-61a9ef99-a2e6-46b4-a06d-c7a386ddd158 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1689 microversion: 2.1 time: 0.191901 Aug 05 02:27:27.437365 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 437/868] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:27 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1689 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:27.483854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] validate_networks() for [('bf7849d5-61da-44b5-8e65-8d7323d12692', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:27:28.309502 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:27:28.310517 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:27:28.310996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:27:28.311401 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:27:28.312001 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:27:28.321950 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:28.322639 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:28.323228 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:28.324203 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:28.324685 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:28.325108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:28.348578 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Getting quotas for project ce1ac0db26e648bba79191b3ad8a260b. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:27:28.356553 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Getting quotas for user 64280d0c3da14f329b6fc21228d92288 and project ce1ac0db26e648bba79191b3ad8a260b. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:27:28.369773 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:27:28.372073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:27:28.445701 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-50c05b4f-3e29-4591-a922-81a7cb6f146b tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.172801 Aug 05 02:27:28.448686 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 432/869] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:27:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:27:28.459012 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8c9eb5be-34cb-4ddd-a920-9d2bd295cd7e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:28.459918 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8c9eb5be-34cb-4ddd-a920-9d2bd295cd7e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:28.602317 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8c9eb5be-34cb-4ddd-a920-9d2bd295cd7e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:28.614047 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8c9eb5be-34cb-4ddd-a920-9d2bd295cd7e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1238 microversion: 2.1 time: 0.159078 Aug 05 02:27:28.615773 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 433/870] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:28 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1238 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:27:28.622637 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-03b09938-ae26-4208-adf3-a43f3838c7c8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:28.623686 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-03b09938-ae26-4208-adf3-a43f3838c7c8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:28.627037 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-580574eb-76ed-4a1f-ab96-7a46ffb799e2 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Action: 'create', calling method: .version_select at 0x7fa65c5eadc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-346462205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCheUtzI/EPXQ7qomhvf2cKsCS8Qrc7pVFq/ItHGL6nimmCPVCYrLts3Pa9BwE6a6+/+r7xrivJs+DtG3q6sM7FH9V+MisAtaJCYEhyEXQWQgEhyMwFVe96Qzg2GvbhU3g=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:27:28.631499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-03b09938-ae26-4208-adf3-a43f3838c7c8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:28.632688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-03b09938-ae26-4208-adf3-a43f3838c7c8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:28.633454 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-03b09938-ae26-4208-adf3-a43f3838c7c8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:28.634415 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-03b09938-ae26-4208-adf3-a43f3838c7c8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:28.635111 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-03b09938-ae26-4208-adf3-a43f3838c7c8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:28.635759 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-03b09938-ae26-4208-adf3-a43f3838c7c8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:28.668552 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-580574eb-76ed-4a1f-ab96-7a46ffb799e2 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Getting quotas for project b3677b84efd24f76bbbc0f8a762ec3f5. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:27:28.680947 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-580574eb-76ed-4a1f-ab96-7a46ffb799e2 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Getting quotas for user d7166065ae65434fbeaff2993a21cc01 and project b3677b84efd24f76bbbc0f8a762ec3f5. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:27:28.716547 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-580574eb-76ed-4a1f-ab96-7a46ffb799e2 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.375314 Aug 05 02:27:28.717212 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 438/871] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Aug 5 02:27:28 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:27:29.158975 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-03b09938-ae26-4208-adf3-a43f3838c7c8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:29.182831 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-03b09938-ae26-4208-adf3-a43f3838c7c8 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1689 microversion: 2.1 time: 0.565741 Aug 05 02:27:29.183435 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 434/872] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:28 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1689 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:29.641471 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-31800069-3524-47ea-850d-8c9bbc7ea0a0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:29.643023 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-31800069-3524-47ea-850d-8c9bbc7ea0a0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:29.662753 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31800069-3524-47ea-850d-8c9bbc7ea0a0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:29.664127 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31800069-3524-47ea-850d-8c9bbc7ea0a0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:29.664808 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31800069-3524-47ea-850d-8c9bbc7ea0a0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:29.666763 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31800069-3524-47ea-850d-8c9bbc7ea0a0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:29.667439 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31800069-3524-47ea-850d-8c9bbc7ea0a0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:29.668091 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-31800069-3524-47ea-850d-8c9bbc7ea0a0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:29.787178 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-31800069-3524-47ea-850d-8c9bbc7ea0a0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:29.819367 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-31800069-3524-47ea-850d-8c9bbc7ea0a0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1290 microversion: 2.1 time: 0.182506 Aug 05 02:27:29.823661 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 439/873] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:29 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1290 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:30.207113 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f0ed9e4b-fc25-440a-b80a-0a12cffbd534 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:30.209739 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f0ed9e4b-fc25-440a-b80a-0a12cffbd534 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:30.231008 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0ed9e4b-fc25-440a-b80a-0a12cffbd534 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:30.231504 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0ed9e4b-fc25-440a-b80a-0a12cffbd534 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:30.235070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0ed9e4b-fc25-440a-b80a-0a12cffbd534 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:30.235990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0ed9e4b-fc25-440a-b80a-0a12cffbd534 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:30.236492 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0ed9e4b-fc25-440a-b80a-0a12cffbd534 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:30.236945 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0ed9e4b-fc25-440a-b80a-0a12cffbd534 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:30.301121 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-aad0dd17-03c6-40c3-8e2d-bd07db6c1676 req-56393422-9b46-4061-858f-c530017de220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c37a85-a2b7-4dec-983c-5b65e70c3aa0", "name": "network-vif-deleted", "tag": "025ccb86-82f0-4646-825e-bf471dd56047"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:27:30.336087 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-aad0dd17-03c6-40c3-8e2d-bd07db6c1676 req-56393422-9b46-4061-858f-c530017de220 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:30.341385 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-aad0dd17-03c6-40c3-8e2d-bd07db6c1676 req-56393422-9b46-4061-858f-c530017de220 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:30.341908 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-aad0dd17-03c6-40c3-8e2d-bd07db6c1676 req-56393422-9b46-4061-858f-c530017de220 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:30.378383 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-aad0dd17-03c6-40c3-8e2d-bd07db6c1676 req-56393422-9b46-4061-858f-c530017de220 service nova] Creating event network-vif-deleted:025ccb86-82f0-4646-825e-bf471dd56047 for instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 on hv-cinder-81558 Aug 05 02:27:30.391854 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-aad0dd17-03c6-40c3-8e2d-bd07db6c1676 req-56393422-9b46-4061-858f-c530017de220 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094245 Aug 05 02:27:30.393135 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 440/874] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:27:30.473550 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f0ed9e4b-fc25-440a-b80a-0a12cffbd534 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:30.484678 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f0ed9e4b-fc25-440a-b80a-0a12cffbd534 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1622 microversion: 2.1 time: 0.283461 Aug 05 02:27:30.485495 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 435/875] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:30 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1622 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:30.845862 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-175d97c3-c111-4b86-8c05-36a0fea9ec08 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:30.847199 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-175d97c3-c111-4b86-8c05-36a0fea9ec08 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:30.861082 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-175d97c3-c111-4b86-8c05-36a0fea9ec08 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:30.866211 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-175d97c3-c111-4b86-8c05-36a0fea9ec08 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:30.866912 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-175d97c3-c111-4b86-8c05-36a0fea9ec08 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:30.871100 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-175d97c3-c111-4b86-8c05-36a0fea9ec08 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:30.871568 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-175d97c3-c111-4b86-8c05-36a0fea9ec08 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:30.872202 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-175d97c3-c111-4b86-8c05-36a0fea9ec08 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:31.018229 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-175d97c3-c111-4b86-8c05-36a0fea9ec08 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:31.036645 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-175d97c3-c111-4b86-8c05-36a0fea9ec08 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1296 microversion: 2.1 time: 0.196341 Aug 05 02:27:31.037867 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 441/876] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:30 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1296 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:31.516701 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fc3522e7-f0e5-4425-8cbd-f2e32983d300 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:31.517327 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fc3522e7-f0e5-4425-8cbd-f2e32983d300 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:31.526549 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc3522e7-f0e5-4425-8cbd-f2e32983d300 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:31.527354 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc3522e7-f0e5-4425-8cbd-f2e32983d300 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:31.528224 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc3522e7-f0e5-4425-8cbd-f2e32983d300 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:31.529232 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc3522e7-f0e5-4425-8cbd-f2e32983d300 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:31.530091 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc3522e7-f0e5-4425-8cbd-f2e32983d300 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:31.530862 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc3522e7-f0e5-4425-8cbd-f2e32983d300 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:31.597733 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc3522e7-f0e5-4425-8cbd-f2e32983d300 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:31.598388 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc3522e7-f0e5-4425-8cbd-f2e32983d300 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:31.598953 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fc3522e7-f0e5-4425-8cbd-f2e32983d300 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:31.599503 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-fc3522e7-f0e5-4425-8cbd-f2e32983d300 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lazy-loading 'fault' on Instance uuid 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:27:31.691183 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fc3522e7-f0e5-4425-8cbd-f2e32983d300 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:31.705620 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fc3522e7-f0e5-4425-8cbd-f2e32983d300 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 200 len: 1335 microversion: 2.1 time: 0.199740 Aug 05 02:27:31.709303 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 436/877] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:31 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 1335 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:32.061874 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9abbb459-c831-48ed-bc60-7ee84b80126a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:32.063128 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9abbb459-c831-48ed-bc60-7ee84b80126a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:32.075296 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9abbb459-c831-48ed-bc60-7ee84b80126a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:32.076115 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9abbb459-c831-48ed-bc60-7ee84b80126a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:32.076821 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9abbb459-c831-48ed-bc60-7ee84b80126a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:32.077764 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9abbb459-c831-48ed-bc60-7ee84b80126a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:32.078456 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9abbb459-c831-48ed-bc60-7ee84b80126a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:32.079064 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9abbb459-c831-48ed-bc60-7ee84b80126a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:32.294195 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9abbb459-c831-48ed-bc60-7ee84b80126a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:32.303740 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9abbb459-c831-48ed-bc60-7ee84b80126a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1364 microversion: 2.1 time: 0.247027 Aug 05 02:27:32.304801 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 442/878] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:32 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:27:32.482056 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-82f714cb-c172-4297-9dab-1af403d51a50 req-624a3c4b-bde0-4d87-b9b7-814e24c6ec81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a62bccf-ee14-4f75-ac75-78872dd510c8", "tag": "632d332a-75d1-454b-bb98-b93cd5e86ca7"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:27:32.494606 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-82f714cb-c172-4297-9dab-1af403d51a50 req-624a3c4b-bde0-4d87-b9b7-814e24c6ec81 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:32.495408 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-82f714cb-c172-4297-9dab-1af403d51a50 req-624a3c4b-bde0-4d87-b9b7-814e24c6ec81 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:32.496049 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-82f714cb-c172-4297-9dab-1af403d51a50 req-624a3c4b-bde0-4d87-b9b7-814e24c6ec81 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:32.508872 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-82f714cb-c172-4297-9dab-1af403d51a50 req-624a3c4b-bde0-4d87-b9b7-814e24c6ec81 service nova] Creating event network-changed:632d332a-75d1-454b-bb98-b93cd5e86ca7 for instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 on hv-cinder-81558 Aug 05 02:27:32.514163 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-82f714cb-c172-4297-9dab-1af403d51a50 req-624a3c4b-bde0-4d87-b9b7-814e24c6ec81 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035854 Aug 05 02:27:32.514781 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 437/879] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:27:32.733831 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3fae88fe-fe55-46a5-ac41-24cdf89c9d73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:32.734448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3fae88fe-fe55-46a5-ac41-24cdf89c9d73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 56c37a85-a2b7-4dec-983c-5b65e70c3aa0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:32.740411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fae88fe-fe55-46a5-ac41-24cdf89c9d73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:32.740894 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fae88fe-fe55-46a5-ac41-24cdf89c9d73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:32.741328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fae88fe-fe55-46a5-ac41-24cdf89c9d73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:32.743310 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fae88fe-fe55-46a5-ac41-24cdf89c9d73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:32.743770 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fae88fe-fe55-46a5-ac41-24cdf89c9d73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:32.744195 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3fae88fe-fe55-46a5-ac41-24cdf89c9d73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:32.760924 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-3fae88fe-fe55-46a5-ac41-24cdf89c9d73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] HTTP exception thrown: Instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 could not be found. Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3fae88fe-fe55-46a5-ac41-24cdf89c9d73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Request method failure captured: Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 HTTP/1.1 Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5uCxqFMV4xjjNEicbwn-Almmx4gjc1pUb71A8FIyVx8kunNx-w_ca81bXVAOmrqecVOU6tQQ9CUuL6-vxI4zUOkgPqmvK3bhOYSnsCfmASkY-Ed2wRrlD38yMwuEjNowSpZxw4W5LwuL9n11WU2krtppQjp6wb1pPplKkDftUslgY Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 00eaaf2e12844123996e26c1827d80b2 Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2105783776 Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:27:32.762608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:27:32.764488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/00eaaf2e12844123996e26c1827d80b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_00eaaf2e12844123996e26c1827d80b2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/00eaaf2e12844123996e26c1827d80b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/00eaaf2e12844123996e26c1827d80b2"}]}] Aug 05 02:27:32.764488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2105783776 Aug 05 02:27:32.764488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 00eaaf2e12844123996e26c1827d80b2 Aug 05 02:27:32.764488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2105783776 Aug 05 02:27:32.764488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-2105783776-project Aug 05 02:27:32.764488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:27:32.764488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:27:32.764488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 5bf84408a3984972a5bb68a3117c0501 Aug 05 02:27:32.764488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2105783776-project Aug 05 02:27:32.764488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:27:32.764488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 could not be found. Aug 05 02:27:32.764488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '56c37a85-a2b7-4dec-983c-5b65e70c3aa0'} Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 could not be found. Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:27:32.768873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 could not be found. Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 could not be found. Aug 05 02:27:32.770382 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:32.771676 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3fae88fe-fe55-46a5-ac41-24cdf89c9d73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Returning 404 to user: Instance 56c37a85-a2b7-4dec-983c-5b65e70c3aa0 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:27:32.771676 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3fae88fe-fe55-46a5-ac41-24cdf89c9d73 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0" status: 404 len: 111 microversion: 2.1 time: 0.034779 Aug 05 02:27:32.771676 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 443/880] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:32 2022] GET /compute/v2.1/servers/56c37a85-a2b7-4dec-983c-5b65e70c3aa0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:27:32.774090 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6578b40d-3ce3-4f64-a590-647e3d476e9f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '.version_select at 0x7fa65c584f70>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:32.794587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6578b40d-3ce3-4f64-a590-647e3d476e9f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-794149257" status: 202 len: 0 microversion: 2.1 time: 0.025148 Aug 05 02:27:32.795164 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 438/881] 10.222.0.15 () {58 vars in 1218 bytes} [Fri Aug 5 02:27:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-794149257 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:27:33.325659 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5ebba49a-cb7b-465a-a75a-1c8975e43da2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:33.326393 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5ebba49a-cb7b-465a-a75a-1c8975e43da2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:33.333295 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ebba49a-cb7b-465a-a75a-1c8975e43da2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:33.333772 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ebba49a-cb7b-465a-a75a-1c8975e43da2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:33.334477 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ebba49a-cb7b-465a-a75a-1c8975e43da2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:33.335871 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ebba49a-cb7b-465a-a75a-1c8975e43da2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:33.336714 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ebba49a-cb7b-465a-a75a-1c8975e43da2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:33.337275 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ebba49a-cb7b-465a-a75a-1c8975e43da2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:33.475317 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5ebba49a-cb7b-465a-a75a-1c8975e43da2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:33.485761 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5ebba49a-cb7b-465a-a75a-1c8975e43da2 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1364 microversion: 2.1 time: 0.163944 Aug 05 02:27:33.486488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 444/882] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:33 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:27:34.507149 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-29c6546e-9f84-4f7a-8b0f-9642108c6fe9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:34.508171 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-29c6546e-9f84-4f7a-8b0f-9642108c6fe9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:34.514759 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29c6546e-9f84-4f7a-8b0f-9642108c6fe9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:34.515254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29c6546e-9f84-4f7a-8b0f-9642108c6fe9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:34.515695 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29c6546e-9f84-4f7a-8b0f-9642108c6fe9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:34.516405 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29c6546e-9f84-4f7a-8b0f-9642108c6fe9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:34.516862 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29c6546e-9f84-4f7a-8b0f-9642108c6fe9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:34.517289 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29c6546e-9f84-4f7a-8b0f-9642108c6fe9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:34.653198 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-29c6546e-9f84-4f7a-8b0f-9642108c6fe9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:34.660719 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-29c6546e-9f84-4f7a-8b0f-9642108c6fe9 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1364 microversion: 2.1 time: 0.158003 Aug 05 02:27:34.661280 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 439/883] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:34 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:35.682827 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-84d8e42e-a58d-4d01-9cb0-8fe19907d047 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:35.683436 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-84d8e42e-a58d-4d01-9cb0-8fe19907d047 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:35.690071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84d8e42e-a58d-4d01-9cb0-8fe19907d047 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:35.690554 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84d8e42e-a58d-4d01-9cb0-8fe19907d047 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:35.690992 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84d8e42e-a58d-4d01-9cb0-8fe19907d047 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:35.691685 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84d8e42e-a58d-4d01-9cb0-8fe19907d047 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:35.692137 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84d8e42e-a58d-4d01-9cb0-8fe19907d047 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:35.692589 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84d8e42e-a58d-4d01-9cb0-8fe19907d047 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:35.831912 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-84d8e42e-a58d-4d01-9cb0-8fe19907d047 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:35.847708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-84d8e42e-a58d-4d01-9cb0-8fe19907d047 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1364 microversion: 2.1 time: 0.169281 Aug 05 02:27:35.848438 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 445/884] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:35 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:35.940343 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3705d233-a3c9-49f5-8ccb-a53b8e44bc83 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:35.940884 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3705d233-a3c9-49f5-8ccb-a53b8e44bc83 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:35.947498 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3705d233-a3c9-49f5-8ccb-a53b8e44bc83 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:35.948057 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3705d233-a3c9-49f5-8ccb-a53b8e44bc83 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:35.948519 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3705d233-a3c9-49f5-8ccb-a53b8e44bc83 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:35.949226 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3705d233-a3c9-49f5-8ccb-a53b8e44bc83 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:35.949671 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3705d233-a3c9-49f5-8ccb-a53b8e44bc83 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:35.950421 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3705d233-a3c9-49f5-8ccb-a53b8e44bc83 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:35.979077 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3705d233-a3c9-49f5-8ccb-a53b8e44bc83 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:27:36.064631 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3705d233-a3c9-49f5-8ccb-a53b8e44bc83 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 204 len: 0 microversion: 2.1 time: 0.128508 Aug 05 02:27:36.065899 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 440/885] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:27:35 2022] DELETE /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:27:36.074582 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-73a2f939-5b6e-4c9f-86ae-5d320993d7e7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:36.075286 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-73a2f939-5b6e-4c9f-86ae-5d320993d7e7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:36.081491 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73a2f939-5b6e-4c9f-86ae-5d320993d7e7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:36.082071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73a2f939-5b6e-4c9f-86ae-5d320993d7e7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:36.082579 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73a2f939-5b6e-4c9f-86ae-5d320993d7e7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:36.083437 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73a2f939-5b6e-4c9f-86ae-5d320993d7e7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:36.083961 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73a2f939-5b6e-4c9f-86ae-5d320993d7e7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:36.084497 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-73a2f939-5b6e-4c9f-86ae-5d320993d7e7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:36.222059 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-73a2f939-5b6e-4c9f-86ae-5d320993d7e7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:36.230623 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-73a2f939-5b6e-4c9f-86ae-5d320993d7e7 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1507 microversion: 2.1 time: 0.160842 Aug 05 02:27:36.231193 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 446/886] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:36 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:36.869232 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-be6d9c1f-576b-4c09-8ef3-a4235295021a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:36.869936 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-be6d9c1f-576b-4c09-8ef3-a4235295021a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:36.876136 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be6d9c1f-576b-4c09-8ef3-a4235295021a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:36.876652 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be6d9c1f-576b-4c09-8ef3-a4235295021a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:36.877122 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be6d9c1f-576b-4c09-8ef3-a4235295021a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:36.877831 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be6d9c1f-576b-4c09-8ef3-a4235295021a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:36.878289 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be6d9c1f-576b-4c09-8ef3-a4235295021a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:36.878720 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-be6d9c1f-576b-4c09-8ef3-a4235295021a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:37.014636 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-be6d9c1f-576b-4c09-8ef3-a4235295021a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:37.018192 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:37.023172 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-be6d9c1f-576b-4c09-8ef3-a4235295021a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1364 microversion: 2.1 time: 0.158250 Aug 05 02:27:37.023742 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 441/887] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:36 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:37.251328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2b7261f9-bd0a-4796-8382-6ceed56b2d8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:37.251933 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2b7261f9-bd0a-4796-8382-6ceed56b2d8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:37.258649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b7261f9-bd0a-4796-8382-6ceed56b2d8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:37.259131 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b7261f9-bd0a-4796-8382-6ceed56b2d8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:37.259564 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b7261f9-bd0a-4796-8382-6ceed56b2d8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:37.260840 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b7261f9-bd0a-4796-8382-6ceed56b2d8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:37.261624 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b7261f9-bd0a-4796-8382-6ceed56b2d8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:37.262048 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2b7261f9-bd0a-4796-8382-6ceed56b2d8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:37.266589 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:37.402590 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2b7261f9-bd0a-4796-8382-6ceed56b2d8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:37.410117 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2b7261f9-bd0a-4796-8382-6ceed56b2d8f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1507 microversion: 2.1 time: 0.162706 Aug 05 02:27:37.410677 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 447/888] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:37 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:27:38.046717 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7da8c09e-f5b7-4f5c-b78d-057f93828e40 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:38.047324 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7da8c09e-f5b7-4f5c-b78d-057f93828e40 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:38.054487 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7da8c09e-f5b7-4f5c-b78d-057f93828e40 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:38.054967 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7da8c09e-f5b7-4f5c-b78d-057f93828e40 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:38.055399 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7da8c09e-f5b7-4f5c-b78d-057f93828e40 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:38.056086 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7da8c09e-f5b7-4f5c-b78d-057f93828e40 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:38.056564 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7da8c09e-f5b7-4f5c-b78d-057f93828e40 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:38.058324 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7da8c09e-f5b7-4f5c-b78d-057f93828e40 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:38.295556 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-ccc8b16f-7fb4-4796-ab81-5a069f3365da req-9f6c5c5f-4e0c-4c51-a18f-159e063ecdfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2", "name": "network-vif-deleted", "tag": "b8c923b8-6769-42f5-972e-79420f4f0498"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:27:38.298605 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7da8c09e-f5b7-4f5c-b78d-057f93828e40 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:38.307416 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7da8c09e-f5b7-4f5c-b78d-057f93828e40 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1364 microversion: 2.1 time: 0.265910 Aug 05 02:27:38.320354 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 442/889] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:38 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:38.320601 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ccc8b16f-7fb4-4796-ab81-5a069f3365da req-9f6c5c5f-4e0c-4c51-a18f-159e063ecdfe service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:38.320601 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ccc8b16f-7fb4-4796-ab81-5a069f3365da req-9f6c5c5f-4e0c-4c51-a18f-159e063ecdfe service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:38.320601 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ccc8b16f-7fb4-4796-ab81-5a069f3365da req-9f6c5c5f-4e0c-4c51-a18f-159e063ecdfe service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:38.336934 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-ccc8b16f-7fb4-4796-ab81-5a069f3365da req-9f6c5c5f-4e0c-4c51-a18f-159e063ecdfe service nova] Creating event network-vif-deleted:b8c923b8-6769-42f5-972e-79420f4f0498 for instance fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 on hv-cinder-81558 Aug 05 02:27:38.343099 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-ccc8b16f-7fb4-4796-ab81-5a069f3365da req-9f6c5c5f-4e0c-4c51-a18f-159e063ecdfe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054405 Aug 05 02:27:38.344017 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 448/890] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:27:38.443467 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-534dedb7-88d4-4406-acb7-4f934d66b4d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:38.444230 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-534dedb7-88d4-4406-acb7-4f934d66b4d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:38.446477 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:38.453372 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-534dedb7-88d4-4406-acb7-4f934d66b4d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:38.454050 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-534dedb7-88d4-4406-acb7-4f934d66b4d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:38.454487 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-534dedb7-88d4-4406-acb7-4f934d66b4d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:38.455456 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-534dedb7-88d4-4406-acb7-4f934d66b4d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:38.455988 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-534dedb7-88d4-4406-acb7-4f934d66b4d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:38.456562 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-534dedb7-88d4-4406-acb7-4f934d66b4d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:38.492009 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-534dedb7-88d4-4406-acb7-4f934d66b4d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:38.492557 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-534dedb7-88d4-4406-acb7-4f934d66b4d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:38.493065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-534dedb7-88d4-4406-acb7-4f934d66b4d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:38.493606 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-534dedb7-88d4-4406-acb7-4f934d66b4d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lazy-loading 'fault' on Instance uuid fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:27:38.544255 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-534dedb7-88d4-4406-acb7-4f934d66b4d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:38.553363 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-534dedb7-88d4-4406-acb7-4f934d66b4d9 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 200 len: 1310 microversion: 2.1 time: 0.126172 Aug 05 02:27:38.553930 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 443/891] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:38 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 1310 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:38.619846 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-b4bf3a9c-10be-47e5-8c94-c25c9a90b78c req-ccad051c-a3ca-4d62-848b-71a895388a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a62bccf-ee14-4f75-ac75-78872dd510c8", "name": "network-vif-plugged", "status": "completed", "tag": "632d332a-75d1-454b-bb98-b93cd5e86ca7"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:27:38.629975 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b4bf3a9c-10be-47e5-8c94-c25c9a90b78c req-ccad051c-a3ca-4d62-848b-71a895388a5d service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:38.630809 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b4bf3a9c-10be-47e5-8c94-c25c9a90b78c req-ccad051c-a3ca-4d62-848b-71a895388a5d service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:38.631399 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b4bf3a9c-10be-47e5-8c94-c25c9a90b78c req-ccad051c-a3ca-4d62-848b-71a895388a5d service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:38.643887 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-b4bf3a9c-10be-47e5-8c94-c25c9a90b78c req-ccad051c-a3ca-4d62-848b-71a895388a5d service nova] Creating event network-vif-plugged:632d332a-75d1-454b-bb98-b93cd5e86ca7 for instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 on hv-cinder-81558 Aug 05 02:27:38.649930 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-b4bf3a9c-10be-47e5-8c94-c25c9a90b78c req-ccad051c-a3ca-4d62-848b-71a895388a5d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038010 Aug 05 02:27:38.652272 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 449/892] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:27:39.330692 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-88db713c-1c40-4782-bf36-5b93e914d199 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:39.331262 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-88db713c-1c40-4782-bf36-5b93e914d199 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:39.333140 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=8 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:39.339292 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88db713c-1c40-4782-bf36-5b93e914d199 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:39.339760 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88db713c-1c40-4782-bf36-5b93e914d199 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:39.340185 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88db713c-1c40-4782-bf36-5b93e914d199 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:39.340890 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88db713c-1c40-4782-bf36-5b93e914d199 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:39.341336 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88db713c-1c40-4782-bf36-5b93e914d199 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:39.341754 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88db713c-1c40-4782-bf36-5b93e914d199 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:39.474487 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-88db713c-1c40-4782-bf36-5b93e914d199 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:39.482807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-88db713c-1c40-4782-bf36-5b93e914d199 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1364 microversion: 2.1 time: 0.156015 Aug 05 02:27:39.483364 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 444/893] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:39 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:39.574513 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=8 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:39.579188 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bb4d861f-75a3-447b-982f-1ce132846283 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:39.579884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bb4d861f-75a3-447b-982f-1ce132846283 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:39.586224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb4d861f-75a3-447b-982f-1ce132846283 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:39.586650 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb4d861f-75a3-447b-982f-1ce132846283 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:39.587110 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb4d861f-75a3-447b-982f-1ce132846283 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:39.588176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb4d861f-75a3-447b-982f-1ce132846283 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:39.588835 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb4d861f-75a3-447b-982f-1ce132846283 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:39.589310 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb4d861f-75a3-447b-982f-1ce132846283 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:39.602808 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-bb4d861f-75a3-447b-982f-1ce132846283 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] HTTP exception thrown: Instance fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 could not be found. Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bb4d861f-75a3-447b-982f-1ce132846283 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Request method failure captured: Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 HTTP/1.1 Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5uCxqFMV4xjjNEicbwn-Almmx4gjc1pUb71A8FIyVx8kunNx-w_ca81bXVAOmrqecVOU6tQQ9CUuL6-vxI4zUOkgPqmvK3bhOYSnsCfmASkY-Ed2wRrlD38yMwuEjNowSpZxw4W5LwuL9n11WU2krtppQjp6wb1pPplKkDftUslgY Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 00eaaf2e12844123996e26c1827d80b2 Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2105783776 Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:27:39.605221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:27:39.606819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/00eaaf2e12844123996e26c1827d80b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_00eaaf2e12844123996e26c1827d80b2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/00eaaf2e12844123996e26c1827d80b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/00eaaf2e12844123996e26c1827d80b2"}]}] Aug 05 02:27:39.606819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2105783776 Aug 05 02:27:39.606819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 00eaaf2e12844123996e26c1827d80b2 Aug 05 02:27:39.606819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2105783776 Aug 05 02:27:39.606819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-2105783776-project Aug 05 02:27:39.606819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:27:39.606819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:27:39.606819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 5bf84408a3984972a5bb68a3117c0501 Aug 05 02:27:39.606819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2105783776-project Aug 05 02:27:39.606819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:27:39.606819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 could not be found. Aug 05 02:27:39.606819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': 'fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2'} Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 could not be found. Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:27:39.607597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 could not be found. Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 could not be found. Aug 05 02:27:39.609040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:39.610162 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bb4d861f-75a3-447b-982f-1ce132846283 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Returning 404 to user: Instance fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:27:39.610162 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bb4d861f-75a3-447b-982f-1ce132846283 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2" status: 404 len: 111 microversion: 2.1 time: 0.033064 Aug 05 02:27:39.610162 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 450/894] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:39 2022] GET /compute/v2.1/servers/fe8d9dfe-4cc8-4d90-8e54-9db66298f0a2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:27:39.616239 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-acd6e5e7-969d-4731-ae6f-b0cc15fa1a63 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:39.616754 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-acd6e5e7-969d-4731-ae6f-b0cc15fa1a63 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:39.624366 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-acd6e5e7-969d-4731-ae6f-b0cc15fa1a63 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:39.624972 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-acd6e5e7-969d-4731-ae6f-b0cc15fa1a63 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:39.625415 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-acd6e5e7-969d-4731-ae6f-b0cc15fa1a63 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:39.626132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-acd6e5e7-969d-4731-ae6f-b0cc15fa1a63 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:39.626588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-acd6e5e7-969d-4731-ae6f-b0cc15fa1a63 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:39.627012 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-acd6e5e7-969d-4731-ae6f-b0cc15fa1a63 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:39.652425 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-acd6e5e7-969d-4731-ae6f-b0cc15fa1a63 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:27:39.727289 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-acd6e5e7-969d-4731-ae6f-b0cc15fa1a63 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "DELETE /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 204 len: 0 microversion: 2.1 time: 0.115076 Aug 05 02:27:39.727869 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 445/895] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:27:39 2022] DELETE /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:27:39.736555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fd0f1381-85cd-4beb-98ed-b7b6d03d244e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:39.737145 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fd0f1381-85cd-4beb-98ed-b7b6d03d244e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:39.743140 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd0f1381-85cd-4beb-98ed-b7b6d03d244e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:39.743621 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd0f1381-85cd-4beb-98ed-b7b6d03d244e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:39.744074 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd0f1381-85cd-4beb-98ed-b7b6d03d244e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:39.745111 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd0f1381-85cd-4beb-98ed-b7b6d03d244e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:39.745564 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd0f1381-85cd-4beb-98ed-b7b6d03d244e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:39.745990 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd0f1381-85cd-4beb-98ed-b7b6d03d244e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:39.883590 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fd0f1381-85cd-4beb-98ed-b7b6d03d244e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:39.892197 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fd0f1381-85cd-4beb-98ed-b7b6d03d244e tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.159476 Aug 05 02:27:39.892801 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 451/896] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:39 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:40.504886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-45c28ed9-f95d-4b74-8dd6-d90926a3bc41 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:40.505586 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-45c28ed9-f95d-4b74-8dd6-d90926a3bc41 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:40.511951 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45c28ed9-f95d-4b74-8dd6-d90926a3bc41 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:40.512470 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45c28ed9-f95d-4b74-8dd6-d90926a3bc41 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:40.512906 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45c28ed9-f95d-4b74-8dd6-d90926a3bc41 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:40.513592 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45c28ed9-f95d-4b74-8dd6-d90926a3bc41 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:40.514043 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45c28ed9-f95d-4b74-8dd6-d90926a3bc41 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:40.514541 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45c28ed9-f95d-4b74-8dd6-d90926a3bc41 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:40.649429 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-45c28ed9-f95d-4b74-8dd6-d90926a3bc41 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:40.660559 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-45c28ed9-f95d-4b74-8dd6-d90926a3bc41 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1364 microversion: 2.1 time: 0.159848 Aug 05 02:27:40.661136 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 446/897] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:40 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:40.913492 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fc06c839-7df0-4c26-9b26-432d9dbb0ffa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:40.914107 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fc06c839-7df0-4c26-9b26-432d9dbb0ffa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:40.921494 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc06c839-7df0-4c26-9b26-432d9dbb0ffa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:40.922011 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc06c839-7df0-4c26-9b26-432d9dbb0ffa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:40.922456 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc06c839-7df0-4c26-9b26-432d9dbb0ffa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:40.923156 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc06c839-7df0-4c26-9b26-432d9dbb0ffa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:40.923610 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc06c839-7df0-4c26-9b26-432d9dbb0ffa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:40.924032 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fc06c839-7df0-4c26-9b26-432d9dbb0ffa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:41.060112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fc06c839-7df0-4c26-9b26-432d9dbb0ffa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:41.067534 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fc06c839-7df0-4c26-9b26-432d9dbb0ffa tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.157980 Aug 05 02:27:41.068096 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 452/898] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:40 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:41.681956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1f7d35dd-4316-4ffc-9ab1-0d3ee516e37a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:41.683624 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1f7d35dd-4316-4ffc-9ab1-0d3ee516e37a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:41.690058 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1f7d35dd-4316-4ffc-9ab1-0d3ee516e37a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:41.690537 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1f7d35dd-4316-4ffc-9ab1-0d3ee516e37a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:41.690970 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1f7d35dd-4316-4ffc-9ab1-0d3ee516e37a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:41.691653 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1f7d35dd-4316-4ffc-9ab1-0d3ee516e37a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:41.692101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1f7d35dd-4316-4ffc-9ab1-0d3ee516e37a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:41.692550 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1f7d35dd-4316-4ffc-9ab1-0d3ee516e37a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:41.823028 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1f7d35dd-4316-4ffc-9ab1-0d3ee516e37a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:41.830558 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1f7d35dd-4316-4ffc-9ab1-0d3ee516e37a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1364 microversion: 2.1 time: 0.152434 Aug 05 02:27:41.831133 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 447/899] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:41 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:42.089957 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f1e83d0d-9523-4995-8f9a-847123cbb36f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:42.090513 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f1e83d0d-9523-4995-8f9a-847123cbb36f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:42.096975 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1e83d0d-9523-4995-8f9a-847123cbb36f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:42.097449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1e83d0d-9523-4995-8f9a-847123cbb36f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:42.097881 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1e83d0d-9523-4995-8f9a-847123cbb36f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:42.098559 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1e83d0d-9523-4995-8f9a-847123cbb36f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:42.099006 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1e83d0d-9523-4995-8f9a-847123cbb36f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:42.099430 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f1e83d0d-9523-4995-8f9a-847123cbb36f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:42.241558 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f1e83d0d-9523-4995-8f9a-847123cbb36f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:42.250958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f1e83d0d-9523-4995-8f9a-847123cbb36f tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.165593 Aug 05 02:27:42.251523 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 453/900] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:42 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:42.851287 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c18c516d-8cfc-41c2-8594-9cf14594628d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:42.852061 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c18c516d-8cfc-41c2-8594-9cf14594628d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:42.859159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c18c516d-8cfc-41c2-8594-9cf14594628d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:42.859727 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c18c516d-8cfc-41c2-8594-9cf14594628d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:42.860188 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c18c516d-8cfc-41c2-8594-9cf14594628d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:42.860896 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c18c516d-8cfc-41c2-8594-9cf14594628d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:42.861343 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c18c516d-8cfc-41c2-8594-9cf14594628d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:42.861775 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c18c516d-8cfc-41c2-8594-9cf14594628d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:42.994305 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c18c516d-8cfc-41c2-8594-9cf14594628d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:43.002318 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c18c516d-8cfc-41c2-8594-9cf14594628d tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1551 microversion: 2.1 time: 0.155347 Aug 05 02:27:43.002888 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 448/901] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:42 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:43.022762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9db1e575-d718-48d5-a761-ea9a899d9a32 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:43.023259 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9db1e575-d718-48d5-a761-ea9a899d9a32 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:43.029160 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9db1e575-d718-48d5-a761-ea9a899d9a32 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:43.029641 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9db1e575-d718-48d5-a761-ea9a899d9a32 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:43.030082 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9db1e575-d718-48d5-a761-ea9a899d9a32 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:43.030770 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9db1e575-d718-48d5-a761-ea9a899d9a32 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:43.031226 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9db1e575-d718-48d5-a761-ea9a899d9a32 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:43.031656 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9db1e575-d718-48d5-a761-ea9a899d9a32 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:43.107076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9db1e575-d718-48d5-a761-ea9a899d9a32 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088064 Aug 05 02:27:43.107691 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 454/902] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Aug 5 02:27:43 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:27:43.272005 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-424ae4ff-6efe-493c-ab9e-dace5e328a9b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:43.272643 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-424ae4ff-6efe-493c-ab9e-dace5e328a9b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:43.279099 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-424ae4ff-6efe-493c-ab9e-dace5e328a9b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:43.279746 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-424ae4ff-6efe-493c-ab9e-dace5e328a9b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:43.280204 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-424ae4ff-6efe-493c-ab9e-dace5e328a9b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:43.280937 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-424ae4ff-6efe-493c-ab9e-dace5e328a9b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:43.281394 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-424ae4ff-6efe-493c-ab9e-dace5e328a9b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:43.281958 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-424ae4ff-6efe-493c-ab9e-dace5e328a9b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:43.496553 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-424ae4ff-6efe-493c-ab9e-dace5e328a9b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf84408a3984972a5bb68a3117c0501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00eaaf2e12844123996e26c1827d80b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:43.505219 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-424ae4ff-6efe-493c-ab9e-dace5e328a9b tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 200 len: 1523 microversion: 2.1 time: 0.237282 Aug 05 02:27:43.506018 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 449/903] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:43 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:43.849469 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-1da21883-a565-48fc-b679-397263b33c64 req-bb989d11-4af8-4c35-9cc4-a43f23c015d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "786487b8-f24e-4034-82da-c95e8efbf4e4", "name": "network-vif-deleted", "tag": "7f1f18fd-2855-4e72-99d7-6356085d6879"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:27:43.861773 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1da21883-a565-48fc-b679-397263b33c64 req-bb989d11-4af8-4c35-9cc4-a43f23c015d2 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:43.862244 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1da21883-a565-48fc-b679-397263b33c64 req-bb989d11-4af8-4c35-9cc4-a43f23c015d2 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:43.862666 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-1da21883-a565-48fc-b679-397263b33c64 req-bb989d11-4af8-4c35-9cc4-a43f23c015d2 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:43.875426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-1da21883-a565-48fc-b679-397263b33c64 req-bb989d11-4af8-4c35-9cc4-a43f23c015d2 service nova] Creating event network-vif-deleted:7f1f18fd-2855-4e72-99d7-6356085d6879 for instance 786487b8-f24e-4034-82da-c95e8efbf4e4 on hv-cinder-81558 Aug 05 02:27:43.880607 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-1da21883-a565-48fc-b679-397263b33c64 req-bb989d11-4af8-4c35-9cc4-a43f23c015d2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035327 Aug 05 02:27:43.881554 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 455/904] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:27:44.062055 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-7c5048e2-abeb-4351-99e0-5a40ddcfc2e1 req-559631bc-c56c-48e4-b340-b63bded0be44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a62bccf-ee14-4f75-ac75-78872dd510c8", "tag": "632d332a-75d1-454b-bb98-b93cd5e86ca7"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:27:44.072003 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-7c5048e2-abeb-4351-99e0-5a40ddcfc2e1 req-559631bc-c56c-48e4-b340-b63bded0be44 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:44.072616 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-7c5048e2-abeb-4351-99e0-5a40ddcfc2e1 req-559631bc-c56c-48e4-b340-b63bded0be44 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:44.073120 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-7c5048e2-abeb-4351-99e0-5a40ddcfc2e1 req-559631bc-c56c-48e4-b340-b63bded0be44 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:44.084645 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-7c5048e2-abeb-4351-99e0-5a40ddcfc2e1 req-559631bc-c56c-48e4-b340-b63bded0be44 service nova] Creating event network-changed:632d332a-75d1-454b-bb98-b93cd5e86ca7 for instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 on hv-cinder-81558 Aug 05 02:27:44.090051 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-7c5048e2-abeb-4351-99e0-5a40ddcfc2e1 req-559631bc-c56c-48e4-b340-b63bded0be44 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032420 Aug 05 02:27:44.090785 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 450/905] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:27:44.529051 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-081c77f5-2eac-4a2c-a1b8-4b99e042c584 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:44.529880 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-081c77f5-2eac-4a2c-a1b8-4b99e042c584 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] [instance: 786487b8-f24e-4034-82da-c95e8efbf4e4] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:44.536883 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-081c77f5-2eac-4a2c-a1b8-4b99e042c584 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:44.537513 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-081c77f5-2eac-4a2c-a1b8-4b99e042c584 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:44.538040 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-081c77f5-2eac-4a2c-a1b8-4b99e042c584 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:44.538871 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-081c77f5-2eac-4a2c-a1b8-4b99e042c584 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:44.539417 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-081c77f5-2eac-4a2c-a1b8-4b99e042c584 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:44.539932 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-081c77f5-2eac-4a2c-a1b8-4b99e042c584 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:44.554307 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-081c77f5-2eac-4a2c-a1b8-4b99e042c584 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] HTTP exception thrown: Instance 786487b8-f24e-4034-82da-c95e8efbf4e4 could not be found. Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-081c77f5-2eac-4a2c-a1b8-4b99e042c584 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Request method failure captured: Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 HTTP/1.1 Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5uCxqFMV4xjjNEicbwn-Almmx4gjc1pUb71A8FIyVx8kunNx-w_ca81bXVAOmrqecVOU6tQQ9CUuL6-vxI4zUOkgPqmvK3bhOYSnsCfmASkY-Ed2wRrlD38yMwuEjNowSpZxw4W5LwuL9n11WU2krtppQjp6wb1pPplKkDftUslgY Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 00eaaf2e12844123996e26c1827d80b2 Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2105783776 Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:27:44.556233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:27:44.558038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/00eaaf2e12844123996e26c1827d80b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_00eaaf2e12844123996e26c1827d80b2", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/00eaaf2e12844123996e26c1827d80b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/00eaaf2e12844123996e26c1827d80b2"}]}] Aug 05 02:27:44.558038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2105783776 Aug 05 02:27:44.558038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 00eaaf2e12844123996e26c1827d80b2 Aug 05 02:27:44.558038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2105783776 Aug 05 02:27:44.558038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-2105783776-project Aug 05 02:27:44.558038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:27:44.558038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:27:44.558038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 5bf84408a3984972a5bb68a3117c0501 Aug 05 02:27:44.558038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2105783776-project Aug 05 02:27:44.558038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:27:44.558038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 786487b8-f24e-4034-82da-c95e8efbf4e4 could not be found. Aug 05 02:27:44.558038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '786487b8-f24e-4034-82da-c95e8efbf4e4'} Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 786487b8-f24e-4034-82da-c95e8efbf4e4 could not be found. Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:27:44.559038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 786487b8-f24e-4034-82da-c95e8efbf4e4 could not be found. Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 786487b8-f24e-4034-82da-c95e8efbf4e4 could not be found. Aug 05 02:27:44.560543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:27:44.562008 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-081c77f5-2eac-4a2c-a1b8-4b99e042c584 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] Returning 404 to user: Instance 786487b8-f24e-4034-82da-c95e8efbf4e4 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:27:44.562971 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-081c77f5-2eac-4a2c-a1b8-4b99e042c584 tempest-ServerRescueNegativeTestJSON-2105783776 tempest-ServerRescueNegativeTestJSON-2105783776-project] 10.222.0.15 "GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4" status: 404 len: 111 microversion: 2.1 time: 0.040092 Aug 05 02:27:44.563614 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 456/906] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:44 2022] GET /compute/v2.1/servers/786487b8-f24e-4034-82da-c95e8efbf4e4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 02:27:53.397237 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1337637339", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-346462205", "security_groups": [{"name": "tempest-secgroup-smoke-546244821"}], "networks": [{"uuid": "54505e31-75ca-4416-ae9a-5b70292fe878"}], "block_device_mapping_v2": [{"uuid": "b84c271f-1ce3-40e9-941c-27c931cc3f21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:27:53.408697 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:53.549053 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] validate_networks() for [('54505e31-75ca-4416-ae9a-5b70292fe878', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:27:53.978161 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:27:53.978614 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:27:53.979081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:27:53.980254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:27:53.980928 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:27:53.989817 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:53.990295 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:53.990781 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:53.991553 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:53.991997 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:53.992506 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:54.009807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Getting quotas for project b3677b84efd24f76bbbc0f8a762ec3f5. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:27:54.013827 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Getting quotas for user d7166065ae65434fbeaff2993a21cc01 and project b3677b84efd24f76bbbc0f8a762ec3f5. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:27:54.076375 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:27:54.078944 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b84c271f-1ce3-40e9-941c-27c931cc3f21',volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:27:54.216777 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a7b3e757-3256-4992-ba04-aac6546e44b8 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.824522 Aug 05 02:27:54.217728 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 451/907] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:27:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:27:54.228670 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-23b73be8-4c41-4929-b6c3-b636ec929522 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:54.229389 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-23b73be8-4c41-4929-b6c3-b636ec929522 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:54.233795 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:54.319211 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-23b73be8-4c41-4929-b6c3-b636ec929522 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:54.326353 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-23b73be8-4c41-4929-b6c3-b636ec929522 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1088 microversion: 2.1 time: 0.102036 Aug 05 02:27:54.326997 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 457/908] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:54 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1088 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:27:55.349432 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-29d7f422-8783-4bb7-8581-74833d937355 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:55.350670 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-29d7f422-8783-4bb7-8581-74833d937355 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:55.358253 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29d7f422-8783-4bb7-8581-74833d937355 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:55.358735 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29d7f422-8783-4bb7-8581-74833d937355 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:55.359162 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29d7f422-8783-4bb7-8581-74833d937355 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:55.359851 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29d7f422-8783-4bb7-8581-74833d937355 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:55.360541 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29d7f422-8783-4bb7-8581-74833d937355 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:55.360951 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-29d7f422-8783-4bb7-8581-74833d937355 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:55.450423 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-29d7f422-8783-4bb7-8581-74833d937355 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:55.458084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-29d7f422-8783-4bb7-8581-74833d937355 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1204 microversion: 2.1 time: 0.113913 Aug 05 02:27:55.458639 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 452/909] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:55 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1204 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:27:56.480490 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-37fb4292-6d6d-4074-af6c-617ae08690f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:56.481270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-37fb4292-6d6d-4074-af6c-617ae08690f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:56.483138 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=36 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:56.489174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37fb4292-6d6d-4074-af6c-617ae08690f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:56.489659 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37fb4292-6d6d-4074-af6c-617ae08690f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:56.490089 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37fb4292-6d6d-4074-af6c-617ae08690f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:56.490815 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37fb4292-6d6d-4074-af6c-617ae08690f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:56.491261 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37fb4292-6d6d-4074-af6c-617ae08690f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:56.491680 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37fb4292-6d6d-4074-af6c-617ae08690f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:56.625277 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-37fb4292-6d6d-4074-af6c-617ae08690f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:56.632816 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-37fb4292-6d6d-4074-af6c-617ae08690f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1259 microversion: 2.1 time: 0.156459 Aug 05 02:27:56.633406 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 458/910] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:56 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:56.767741 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-f05a5454-11cc-405b-94f9-d7b5432cf39c req-c442ffcc-328d-4402-a67b-0ace854980f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb56ea7-8771-41b9-b537-a6d4afeda7ab", "tag": "652b8180-4f83-4880-81b9-b44df98605a9"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:27:56.780530 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f05a5454-11cc-405b-94f9-d7b5432cf39c req-c442ffcc-328d-4402-a67b-0ace854980f0 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:56.781013 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f05a5454-11cc-405b-94f9-d7b5432cf39c req-c442ffcc-328d-4402-a67b-0ace854980f0 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:56.781496 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f05a5454-11cc-405b-94f9-d7b5432cf39c req-c442ffcc-328d-4402-a67b-0ace854980f0 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:56.792710 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-f05a5454-11cc-405b-94f9-d7b5432cf39c req-c442ffcc-328d-4402-a67b-0ace854980f0 service nova] Creating event network-changed:652b8180-4f83-4880-81b9-b44df98605a9 for instance 5eb56ea7-8771-41b9-b537-a6d4afeda7ab on hv-cinder-81558 Aug 05 02:27:56.797720 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-f05a5454-11cc-405b-94f9-d7b5432cf39c req-c442ffcc-328d-4402-a67b-0ace854980f0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037763 Aug 05 02:27:56.798385 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 453/911] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:27:57.654394 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-95ac0b46-4cf9-4b27-9fb2-b5a7a7d6b806 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:57.655006 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-95ac0b46-4cf9-4b27-9fb2-b5a7a7d6b806 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:57.661551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95ac0b46-4cf9-4b27-9fb2-b5a7a7d6b806 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:57.662028 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95ac0b46-4cf9-4b27-9fb2-b5a7a7d6b806 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:57.662633 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95ac0b46-4cf9-4b27-9fb2-b5a7a7d6b806 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:57.663383 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95ac0b46-4cf9-4b27-9fb2-b5a7a7d6b806 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:57.664107 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95ac0b46-4cf9-4b27-9fb2-b5a7a7d6b806 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:57.664559 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95ac0b46-4cf9-4b27-9fb2-b5a7a7d6b806 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:57.803748 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-95ac0b46-4cf9-4b27-9fb2-b5a7a7d6b806 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:57.811890 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-95ac0b46-4cf9-4b27-9fb2-b5a7a7d6b806 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1259 microversion: 2.1 time: 0.161346 Aug 05 02:27:57.812488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 459/912] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:57 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:27:58.833154 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6b150d32-54c4-4b6d-9a68-f96fe704ea42 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:27:58.833848 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6b150d32-54c4-4b6d-9a68-f96fe704ea42 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:27:58.840680 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b150d32-54c4-4b6d-9a68-f96fe704ea42 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:58.841371 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b150d32-54c4-4b6d-9a68-f96fe704ea42 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:58.841804 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b150d32-54c4-4b6d-9a68-f96fe704ea42 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:58.842653 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b150d32-54c4-4b6d-9a68-f96fe704ea42 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:27:58.843105 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b150d32-54c4-4b6d-9a68-f96fe704ea42 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:27:58.843524 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6b150d32-54c4-4b6d-9a68-f96fe704ea42 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:27:58.992314 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6b150d32-54c4-4b6d-9a68-f96fe704ea42 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:27:59.000263 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6b150d32-54c4-4b6d-9a68-f96fe704ea42 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1259 microversion: 2.1 time: 0.171421 Aug 05 02:27:59.000858 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 454/913] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:27:58 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:00.021550 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-effdee03-f79a-468b-be25-9179f7f8e96a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:00.022166 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-effdee03-f79a-468b-be25-9179f7f8e96a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:00.029333 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-effdee03-f79a-468b-be25-9179f7f8e96a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:00.029824 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-effdee03-f79a-468b-be25-9179f7f8e96a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:00.030267 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-effdee03-f79a-468b-be25-9179f7f8e96a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:00.030967 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-effdee03-f79a-468b-be25-9179f7f8e96a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:00.031430 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-effdee03-f79a-468b-be25-9179f7f8e96a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:00.031862 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-effdee03-f79a-468b-be25-9179f7f8e96a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:00.171825 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-effdee03-f79a-468b-be25-9179f7f8e96a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:00.179551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-effdee03-f79a-468b-be25-9179f7f8e96a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1259 microversion: 2.1 time: 0.162074 Aug 05 02:28:00.180248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 460/914] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:00 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:01.201278 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c77abc47-150d-490a-b214-c79ea80e3e16 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:01.201884 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c77abc47-150d-490a-b214-c79ea80e3e16 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:01.208194 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c77abc47-150d-490a-b214-c79ea80e3e16 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:01.208704 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c77abc47-150d-490a-b214-c79ea80e3e16 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:01.209134 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c77abc47-150d-490a-b214-c79ea80e3e16 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:01.209818 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c77abc47-150d-490a-b214-c79ea80e3e16 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:01.210269 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c77abc47-150d-490a-b214-c79ea80e3e16 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:01.210690 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c77abc47-150d-490a-b214-c79ea80e3e16 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:01.345344 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c77abc47-150d-490a-b214-c79ea80e3e16 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:01.352705 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c77abc47-150d-490a-b214-c79ea80e3e16 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1259 microversion: 2.1 time: 0.155356 Aug 05 02:28:01.353584 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 455/915] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:01 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:02.376702 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c25bad36-472f-40ff-b39d-7aabca5ce2c3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:02.377342 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c25bad36-472f-40ff-b39d-7aabca5ce2c3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:02.384261 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c25bad36-472f-40ff-b39d-7aabca5ce2c3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:02.385333 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c25bad36-472f-40ff-b39d-7aabca5ce2c3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:02.386053 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c25bad36-472f-40ff-b39d-7aabca5ce2c3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:02.386846 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c25bad36-472f-40ff-b39d-7aabca5ce2c3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:02.387409 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c25bad36-472f-40ff-b39d-7aabca5ce2c3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:02.387799 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c25bad36-472f-40ff-b39d-7aabca5ce2c3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:02.530924 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c25bad36-472f-40ff-b39d-7aabca5ce2c3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:02.538837 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c25bad36-472f-40ff-b39d-7aabca5ce2c3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1259 microversion: 2.1 time: 0.167625 Aug 05 02:28:02.539410 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 461/916] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:02 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:03.559090 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9e1f97f3-0e01-42ac-beaa-dc570e078155 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:03.559645 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9e1f97f3-0e01-42ac-beaa-dc570e078155 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:03.565893 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e1f97f3-0e01-42ac-beaa-dc570e078155 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:03.566378 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e1f97f3-0e01-42ac-beaa-dc570e078155 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:03.566810 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e1f97f3-0e01-42ac-beaa-dc570e078155 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:03.567492 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e1f97f3-0e01-42ac-beaa-dc570e078155 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:03.567946 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e1f97f3-0e01-42ac-beaa-dc570e078155 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:03.568386 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9e1f97f3-0e01-42ac-beaa-dc570e078155 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:03.700705 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9e1f97f3-0e01-42ac-beaa-dc570e078155 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:03.708116 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9e1f97f3-0e01-42ac-beaa-dc570e078155 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1259 microversion: 2.1 time: 0.153061 Aug 05 02:28:03.708713 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 456/917] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:03 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:04.727732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b4fe2bfc-ea1e-4276-a248-acdaeb0fbcf1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:04.728352 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b4fe2bfc-ea1e-4276-a248-acdaeb0fbcf1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:04.731496 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:04.736666 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4fe2bfc-ea1e-4276-a248-acdaeb0fbcf1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:04.737166 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4fe2bfc-ea1e-4276-a248-acdaeb0fbcf1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:04.737603 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4fe2bfc-ea1e-4276-a248-acdaeb0fbcf1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:04.738289 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4fe2bfc-ea1e-4276-a248-acdaeb0fbcf1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:04.738738 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4fe2bfc-ea1e-4276-a248-acdaeb0fbcf1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:04.739159 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4fe2bfc-ea1e-4276-a248-acdaeb0fbcf1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:04.876649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b4fe2bfc-ea1e-4276-a248-acdaeb0fbcf1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:04.884427 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b4fe2bfc-ea1e-4276-a248-acdaeb0fbcf1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1259 microversion: 2.1 time: 0.160418 Aug 05 02:28:04.884943 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 462/918] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:04 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:05.905965 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d7e9e72d-5cb8-420d-ac54-58c77d22ef77 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:05.906672 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d7e9e72d-5cb8-420d-ac54-58c77d22ef77 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:05.908722 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:05.909451 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:05.915827 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d7e9e72d-5cb8-420d-ac54-58c77d22ef77 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:05.917477 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d7e9e72d-5cb8-420d-ac54-58c77d22ef77 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:05.917924 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d7e9e72d-5cb8-420d-ac54-58c77d22ef77 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:05.918617 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d7e9e72d-5cb8-420d-ac54-58c77d22ef77 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:05.919072 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d7e9e72d-5cb8-420d-ac54-58c77d22ef77 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:05.919495 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d7e9e72d-5cb8-420d-ac54-58c77d22ef77 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:06.068201 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d7e9e72d-5cb8-420d-ac54-58c77d22ef77 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:06.075835 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d7e9e72d-5cb8-420d-ac54-58c77d22ef77 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1259 microversion: 2.1 time: 0.173734 Aug 05 02:28:06.076472 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 457/919] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:05 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:07.099305 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-093ec69d-ab58-4784-b08d-c53f8efac421 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:07.099925 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-093ec69d-ab58-4784-b08d-c53f8efac421 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:07.106438 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-093ec69d-ab58-4784-b08d-c53f8efac421 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:07.106920 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-093ec69d-ab58-4784-b08d-c53f8efac421 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:07.107356 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-093ec69d-ab58-4784-b08d-c53f8efac421 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:07.108053 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-093ec69d-ab58-4784-b08d-c53f8efac421 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:07.108533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-093ec69d-ab58-4784-b08d-c53f8efac421 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:07.108956 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-093ec69d-ab58-4784-b08d-c53f8efac421 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:07.249204 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-093ec69d-ab58-4784-b08d-c53f8efac421 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:07.256967 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-093ec69d-ab58-4784-b08d-c53f8efac421 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1259 microversion: 2.1 time: 0.162468 Aug 05 02:28:07.257679 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 463/920] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:07 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:28:08.279434 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-765dc213-660b-4b2a-9f08-aea450b5fdae tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:08.280040 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-765dc213-660b-4b2a-9f08-aea450b5fdae tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:08.286529 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-765dc213-660b-4b2a-9f08-aea450b5fdae tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:08.287050 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-765dc213-660b-4b2a-9f08-aea450b5fdae tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:08.287479 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-765dc213-660b-4b2a-9f08-aea450b5fdae tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:08.288163 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-765dc213-660b-4b2a-9f08-aea450b5fdae tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:08.288650 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-765dc213-660b-4b2a-9f08-aea450b5fdae tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:08.289075 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-765dc213-660b-4b2a-9f08-aea450b5fdae tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:08.294105 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:08.422074 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-765dc213-660b-4b2a-9f08-aea450b5fdae tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:08.429498 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-765dc213-660b-4b2a-9f08-aea450b5fdae tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1259 microversion: 2.1 time: 0.154785 Aug 05 02:28:08.430057 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 458/921] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:08 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:08.619333 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-cfb86ace-d252-4a65-90ff-066b94337647 req-422d0ac8-c1d5-450e-8560-87fd8f0fb247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb56ea7-8771-41b9-b537-a6d4afeda7ab", "name": "network-vif-plugged", "status": "completed", "tag": "652b8180-4f83-4880-81b9-b44df98605a9"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:28:08.628933 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-cfb86ace-d252-4a65-90ff-066b94337647 req-422d0ac8-c1d5-450e-8560-87fd8f0fb247 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:08.629471 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-cfb86ace-d252-4a65-90ff-066b94337647 req-422d0ac8-c1d5-450e-8560-87fd8f0fb247 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:08.629902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-cfb86ace-d252-4a65-90ff-066b94337647 req-422d0ac8-c1d5-450e-8560-87fd8f0fb247 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:08.642015 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-cfb86ace-d252-4a65-90ff-066b94337647 req-422d0ac8-c1d5-450e-8560-87fd8f0fb247 service nova] Creating event network-vif-plugged:652b8180-4f83-4880-81b9-b44df98605a9 for instance 5eb56ea7-8771-41b9-b537-a6d4afeda7ab on hv-cinder-81558 Aug 05 02:28:08.646836 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-cfb86ace-d252-4a65-90ff-066b94337647 req-422d0ac8-c1d5-450e-8560-87fd8f0fb247 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031163 Aug 05 02:28:08.647448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 464/922] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:28:09.450041 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b0b42067-668e-422f-9931-fde0102c4ef4 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:09.450662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b0b42067-668e-422f-9931-fde0102c4ef4 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:09.456871 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b0b42067-668e-422f-9931-fde0102c4ef4 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:09.457379 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b0b42067-668e-422f-9931-fde0102c4ef4 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:09.457848 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b0b42067-668e-422f-9931-fde0102c4ef4 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:09.458614 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b0b42067-668e-422f-9931-fde0102c4ef4 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:09.459118 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b0b42067-668e-422f-9931-fde0102c4ef4 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:09.459558 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b0b42067-668e-422f-9931-fde0102c4ef4 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:09.597656 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b0b42067-668e-422f-9931-fde0102c4ef4 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:09.605384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b0b42067-668e-422f-9931-fde0102c4ef4 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1259 microversion: 2.1 time: 0.159399 Aug 05 02:28:09.606574 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 459/923] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:09 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:10.628628 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb088efe-05cf-49c9-9128-aa64f8a6a9a6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:10.629329 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cb088efe-05cf-49c9-9128-aa64f8a6a9a6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:10.635414 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb088efe-05cf-49c9-9128-aa64f8a6a9a6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:10.635897 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb088efe-05cf-49c9-9128-aa64f8a6a9a6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:10.636353 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb088efe-05cf-49c9-9128-aa64f8a6a9a6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:10.637157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb088efe-05cf-49c9-9128-aa64f8a6a9a6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:10.637778 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb088efe-05cf-49c9-9128-aa64f8a6a9a6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:10.638208 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb088efe-05cf-49c9-9128-aa64f8a6a9a6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:10.769136 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb088efe-05cf-49c9-9128-aa64f8a6a9a6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:10.776522 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb088efe-05cf-49c9-9128-aa64f8a6a9a6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1444 microversion: 2.1 time: 0.152605 Aug 05 02:28:10.777088 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 465/924] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:10 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:10.797378 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-34697a99-f2cb-417b-bad8-13bc673ffa2e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:10.797979 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-34697a99-f2cb-417b-bad8-13bc673ffa2e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:10.804313 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34697a99-f2cb-417b-bad8-13bc673ffa2e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:10.804813 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34697a99-f2cb-417b-bad8-13bc673ffa2e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:10.805243 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34697a99-f2cb-417b-bad8-13bc673ffa2e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:10.805917 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34697a99-f2cb-417b-bad8-13bc673ffa2e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:10.806360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34697a99-f2cb-417b-bad8-13bc673ffa2e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:10.806777 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-34697a99-f2cb-417b-bad8-13bc673ffa2e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:10.945949 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-34697a99-f2cb-417b-bad8-13bc673ffa2e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:10.954872 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-34697a99-f2cb-417b-bad8-13bc673ffa2e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1444 microversion: 2.1 time: 0.161719 Aug 05 02:28:10.955583 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 460/925] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:10 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:12.731876 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-5c9d7851-f6ae-442b-91d1-7f66f9301c34 req-8df9dfb1-0079-405e-b751-69c0b4935eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb56ea7-8771-41b9-b537-a6d4afeda7ab", "tag": "652b8180-4f83-4880-81b9-b44df98605a9"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:28:12.741679 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5c9d7851-f6ae-442b-91d1-7f66f9301c34 req-8df9dfb1-0079-405e-b751-69c0b4935eb8 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:12.742152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5c9d7851-f6ae-442b-91d1-7f66f9301c34 req-8df9dfb1-0079-405e-b751-69c0b4935eb8 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:12.742851 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5c9d7851-f6ae-442b-91d1-7f66f9301c34 req-8df9dfb1-0079-405e-b751-69c0b4935eb8 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:12.754268 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-5c9d7851-f6ae-442b-91d1-7f66f9301c34 req-8df9dfb1-0079-405e-b751-69c0b4935eb8 service nova] Creating event network-changed:652b8180-4f83-4880-81b9-b44df98605a9 for instance 5eb56ea7-8771-41b9-b537-a6d4afeda7ab on hv-cinder-81558 Aug 05 02:28:12.759287 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-5c9d7851-f6ae-442b-91d1-7f66f9301c34 req-8df9dfb1-0079-405e-b751-69c0b4935eb8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031317 Aug 05 02:28:12.759919 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 466/926] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:28:13.829635 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0f1d4cee-5f61-4b7c-9d63-4ee4c98be60f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:13.830802 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0f1d4cee-5f61-4b7c-9d63-4ee4c98be60f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:13.846634 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f1d4cee-5f61-4b7c-9d63-4ee4c98be60f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:13.847123 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f1d4cee-5f61-4b7c-9d63-4ee4c98be60f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:13.847554 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f1d4cee-5f61-4b7c-9d63-4ee4c98be60f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:13.848248 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f1d4cee-5f61-4b7c-9d63-4ee4c98be60f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:13.848727 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f1d4cee-5f61-4b7c-9d63-4ee4c98be60f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:13.849217 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0f1d4cee-5f61-4b7c-9d63-4ee4c98be60f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:13.874243 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0f1d4cee-5f61-4b7c-9d63-4ee4c98be60f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/ips" status: 200 len: 149 microversion: 2.1 time: 0.050295 Aug 05 02:28:13.881016 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 461/927] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Aug 5 02:28:13 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/ips => generated 149 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:28:15.242619 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4533eabc-2842-42a7-a743-58d4c1bbaf68 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdb40f27-4761-4999-86b9-b8875a7722e3"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:28:15.245037 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4533eabc-2842-42a7-a743-58d4c1bbaf68 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:15.251165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4533eabc-2842-42a7-a743-58d4c1bbaf68 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:15.251650 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4533eabc-2842-42a7-a743-58d4c1bbaf68 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:15.252087 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4533eabc-2842-42a7-a743-58d4c1bbaf68 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:15.252819 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4533eabc-2842-42a7-a743-58d4c1bbaf68 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:15.253278 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4533eabc-2842-42a7-a743-58d4c1bbaf68 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:15.253703 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4533eabc-2842-42a7-a743-58d4c1bbaf68 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:15.520808 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4533eabc-2842-42a7-a743-58d4c1bbaf68 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "POST /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282786 Aug 05 02:28:15.521414 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 467/928] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Aug 5 02:28:15 2022] POST /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:28:18.477204 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1140590890", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452", "networks": [{"uuid": "fa472d95-83d0-4e82-b169-3c906c731c37"}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:28:18.528351 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] validate_networks() for [('fa472d95-83d0-4e82-b169-3c906c731c37', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:28:19.113273 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:28:19.113689 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:28:19.114153 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:28:19.114551 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:28:19.114952 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:28:19.124788 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:19.125257 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:19.125681 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:19.126395 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:19.126837 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:19.127254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:19.143942 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Getting quotas for project 8aeb435284914740b100d506c74bad6b. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:28:19.147904 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Getting quotas for user bf4c0ebf69394f49abfb31e297dafccf and project 8aeb435284914740b100d506c74bad6b. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:28:19.158467 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:28:19.160664 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:28:19.204759 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-42c178b2-deb6-452e-b04a-ab640706ab8c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731455 Aug 05 02:28:19.205389 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 462/929] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:28:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:28:19.217369 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d5e85a27-b5fb-48ba-ac86-08392a4a72df tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:19.218061 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d5e85a27-b5fb-48ba-ac86-08392a4a72df tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:19.280218 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d5e85a27-b5fb-48ba-ac86-08392a4a72df tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:19.287237 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d5e85a27-b5fb-48ba-ac86-08392a4a72df tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 200 len: 1219 microversion: 2.1 time: 0.074521 Aug 05 02:28:19.288360 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 468/930] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:19 2022] GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:20.309314 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d8f94f66-e4c2-48bc-97eb-a5301d300548 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:20.311020 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d8f94f66-e4c2-48bc-97eb-a5301d300548 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:20.318179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8f94f66-e4c2-48bc-97eb-a5301d300548 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:20.318797 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8f94f66-e4c2-48bc-97eb-a5301d300548 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:20.319472 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8f94f66-e4c2-48bc-97eb-a5301d300548 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:20.320234 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8f94f66-e4c2-48bc-97eb-a5301d300548 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:20.321067 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8f94f66-e4c2-48bc-97eb-a5301d300548 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:20.321572 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d8f94f66-e4c2-48bc-97eb-a5301d300548 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:20.399735 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d8f94f66-e4c2-48bc-97eb-a5301d300548 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:20.407605 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d8f94f66-e4c2-48bc-97eb-a5301d300548 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 200 len: 1277 microversion: 2.1 time: 0.103301 Aug 05 02:28:20.408166 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 463/931] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:20 2022] GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:21.429550 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d4ed482e-2353-4160-b3c8-86517d09c4f7 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:21.430172 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d4ed482e-2353-4160-b3c8-86517d09c4f7 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:21.437689 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4ed482e-2353-4160-b3c8-86517d09c4f7 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:21.438177 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4ed482e-2353-4160-b3c8-86517d09c4f7 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:21.438616 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4ed482e-2353-4160-b3c8-86517d09c4f7 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:21.439312 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4ed482e-2353-4160-b3c8-86517d09c4f7 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:21.439772 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4ed482e-2353-4160-b3c8-86517d09c4f7 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:21.440202 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4ed482e-2353-4160-b3c8-86517d09c4f7 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:21.501666 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-90862af4-067c-441e-801c-201936f171d9 req-31cb8f26-c984-4086-8080-25e5b581ff58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd8f5d3f-23c3-4e26-a9e2-78c610209aa1", "tag": "66177fbd-6947-4a08-a7d0-b06472880f9f"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:28:21.512994 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-90862af4-067c-441e-801c-201936f171d9 req-31cb8f26-c984-4086-8080-25e5b581ff58 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:21.514476 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-90862af4-067c-441e-801c-201936f171d9 req-31cb8f26-c984-4086-8080-25e5b581ff58 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:21.515075 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-90862af4-067c-441e-801c-201936f171d9 req-31cb8f26-c984-4086-8080-25e5b581ff58 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:21.531751 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-90862af4-067c-441e-801c-201936f171d9 req-31cb8f26-c984-4086-8080-25e5b581ff58 service nova] Creating event network-changed:66177fbd-6947-4a08-a7d0-b06472880f9f for instance bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 on hv-cinder-81558 Aug 05 02:28:21.537214 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-90862af4-067c-441e-801c-201936f171d9 req-31cb8f26-c984-4086-8080-25e5b581ff58 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040904 Aug 05 02:28:21.538368 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 464/932] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:28:21.575915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d4ed482e-2353-4160-b3c8-86517d09c4f7 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:21.583441 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d4ed482e-2353-4160-b3c8-86517d09c4f7 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 200 len: 1319 microversion: 2.1 time: 0.157783 Aug 05 02:28:21.584014 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 469/933] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:21 2022] GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:22.605815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-dbd8fa79-942c-47f5-8f48-3fd11b617dc0 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:22.607176 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dbd8fa79-942c-47f5-8f48-3fd11b617dc0 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:22.613928 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbd8fa79-942c-47f5-8f48-3fd11b617dc0 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:22.614485 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbd8fa79-942c-47f5-8f48-3fd11b617dc0 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:22.615037 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbd8fa79-942c-47f5-8f48-3fd11b617dc0 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:22.615803 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbd8fa79-942c-47f5-8f48-3fd11b617dc0 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:22.616380 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbd8fa79-942c-47f5-8f48-3fd11b617dc0 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:22.617212 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbd8fa79-942c-47f5-8f48-3fd11b617dc0 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:22.818367 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-dbd8fa79-942c-47f5-8f48-3fd11b617dc0 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:22.825960 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-dbd8fa79-942c-47f5-8f48-3fd11b617dc0 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 200 len: 1319 microversion: 2.1 time: 0.224715 Aug 05 02:28:22.826523 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 465/934] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:22 2022] GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:23.074564 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-09ed4265-ec99-4110-b9bc-d3626de5480e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdb40f27-4761-4999-86b9-b8875a7722e3"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:28:23.077448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-09ed4265-ec99-4110-b9bc-d3626de5480e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:23.083760 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09ed4265-ec99-4110-b9bc-d3626de5480e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:23.084246 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09ed4265-ec99-4110-b9bc-d3626de5480e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:23.084712 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09ed4265-ec99-4110-b9bc-d3626de5480e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:23.085400 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09ed4265-ec99-4110-b9bc-d3626de5480e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:23.085852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09ed4265-ec99-4110-b9bc-d3626de5480e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:23.086543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09ed4265-ec99-4110-b9bc-d3626de5480e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:23.166703 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-09ed4265-ec99-4110-b9bc-d3626de5480e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] HTTP exception thrown: Invalid volume: volume fdb40f27-4761-4999-86b9-b8875a7722e3 is already attached to instances: 17a74b7e-5eed-4b83-8abb-d300e6662c14 Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-09ed4265-ec99-4110-b9bc-d3626de5480e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Request method failure captured: Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-volume_attachments HTTP/1.1 Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 74 Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5pSyPEti3j-9gLBxlgA1L_GuWB6iJvenWVBmfr31mrg4vu4HTgr4mx0c2q3ZmjrMdxdtLzCg8wRia849DSEc7AfP2crmxulEg45Cq3I2oORZ75mc5ksg7ZmJKJ4cA2qZbyq7NZRhJeqx1H2xWUpibdSGnuQ0avaMqjO9VbCjnpzbo Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:28:23.168450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:28:23.170112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ad6a220b99d94a648150476bf0a01e50", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}] Aug 05 02:28:23.170112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:28:23.170112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:28:23.170112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:28:23.170112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:28:23.170112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:28:23.170112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:28:23.170112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 600f51be8202427fb3691db566ed2ff2 Aug 05 02:28:23.170112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:28:23.170112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Aug 05 02:28:23.170112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {"volumeAttachment": {"volumeId": "fdb40f27-4761-4999-86b9-b8875a7722e3"}} Aug 05 02:28:23.170112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Invalid volume: volume fdb40f27-4761-4999-86b9-b8875a7722e3 is already attached to instances: 17a74b7e-5eed-4b83-8abb-d300e6662c14 Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'server_id': '17a74b7e-5eed-4b83-8abb-d300e6662c14', 'body': {'volumeAttachment': {'volumeId': 'fdb40f27-4761-4999-86b9-b8875a7722e3'}}} Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fdb40f27-4761-4999-86b9-b8875a7722e3 is already attached to instances: 17a74b7e-5eed-4b83-8abb-d300e6662c14 Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:28:23.171055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fdb40f27-4761-4999-86b9-b8875a7722e3 is already attached to instances: 17a74b7e-5eed-4b83-8abb-d300e6662c14 Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:28:23.172535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:28:23.174031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:28:23.174031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:28:23.174031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:28:23.174031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fdb40f27-4761-4999-86b9-b8875a7722e3 is already attached to instances: 17a74b7e-5eed-4b83-8abb-d300e6662c14 Aug 05 02:28:23.174031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:28:23.174031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-09ed4265-ec99-4110-b9bc-d3626de5480e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Returning 400 to user: Invalid volume: volume fdb40f27-4761-4999-86b9-b8875a7722e3 is already attached to instances: 17a74b7e-5eed-4b83-8abb-d300e6662c14 {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:28:23.174031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-09ed4265-ec99-4110-b9bc-d3626de5480e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "POST /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099797 Aug 05 02:28:23.174031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 470/935] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Aug 5 02:28:23 2022] POST /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 02:28:23.237319 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8bf909d4-903d-4f18-b90a-4474122b4d9d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:23.237825 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8bf909d4-903d-4f18-b90a-4474122b4d9d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:23.243792 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bf909d4-903d-4f18-b90a-4474122b4d9d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:23.244272 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bf909d4-903d-4f18-b90a-4474122b4d9d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:23.244766 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bf909d4-903d-4f18-b90a-4474122b4d9d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:23.245446 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bf909d4-903d-4f18-b90a-4474122b4d9d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:23.245895 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bf909d4-903d-4f18-b90a-4474122b4d9d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:23.246314 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8bf909d4-903d-4f18-b90a-4474122b4d9d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:23.326669 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-8bf909d4-903d-4f18-b90a-4474122b4d9d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lazy-loading 'services' on Instance uuid 17a74b7e-5eed-4b83-8abb-d300e6662c14 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:28:23.398888 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8bf909d4-903d-4f18-b90a-4474122b4d9d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "DELETE /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-volume_attachments/fdb40f27-4761-4999-86b9-b8875a7722e3" status: 202 len: 0 microversion: 2.1 time: 0.165288 Aug 05 02:28:23.399468 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 466/936] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Aug 5 02:28:23 2022] DELETE /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-volume_attachments/fdb40f27-4761-4999-86b9-b8875a7722e3 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:28:23.408349 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0717e020-55c3-4400-8cfb-f79b97bbece9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:23.410533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0717e020-55c3-4400-8cfb-f79b97bbece9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:23.417184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0717e020-55c3-4400-8cfb-f79b97bbece9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:23.417664 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0717e020-55c3-4400-8cfb-f79b97bbece9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:23.418092 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0717e020-55c3-4400-8cfb-f79b97bbece9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:23.418767 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0717e020-55c3-4400-8cfb-f79b97bbece9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:23.419215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0717e020-55c3-4400-8cfb-f79b97bbece9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:23.419632 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0717e020-55c3-4400-8cfb-f79b97bbece9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:23.447502 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0717e020-55c3-4400-8cfb-f79b97bbece9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043031 Aug 05 02:28:23.448041 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 471/937] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:28:23 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:28:23.847922 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f39e8202-943d-403c-8e39-a75a2ccf1060 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:23.848719 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f39e8202-943d-403c-8e39-a75a2ccf1060 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:23.850759 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:23.857182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f39e8202-943d-403c-8e39-a75a2ccf1060 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:23.857674 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f39e8202-943d-403c-8e39-a75a2ccf1060 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:23.858108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f39e8202-943d-403c-8e39-a75a2ccf1060 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:23.858807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f39e8202-943d-403c-8e39-a75a2ccf1060 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:23.859263 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f39e8202-943d-403c-8e39-a75a2ccf1060 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:23.859685 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f39e8202-943d-403c-8e39-a75a2ccf1060 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:23.996203 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f39e8202-943d-403c-8e39-a75a2ccf1060 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:24.004135 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f39e8202-943d-403c-8e39-a75a2ccf1060 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 200 len: 1319 microversion: 2.1 time: 0.161101 Aug 05 02:28:24.004726 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 467/938] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:23 2022] GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:24.461413 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2e9eadc9-59cf-4d97-a934-a3ddfed95cd0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:24.463422 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2e9eadc9-59cf-4d97-a934-a3ddfed95cd0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:24.466295 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=34 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:24.471545 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e9eadc9-59cf-4d97-a934-a3ddfed95cd0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:24.472018 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e9eadc9-59cf-4d97-a934-a3ddfed95cd0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:24.472507 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e9eadc9-59cf-4d97-a934-a3ddfed95cd0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:24.473189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e9eadc9-59cf-4d97-a934-a3ddfed95cd0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:24.473634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e9eadc9-59cf-4d97-a934-a3ddfed95cd0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:24.474049 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e9eadc9-59cf-4d97-a934-a3ddfed95cd0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:24.503397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2e9eadc9-59cf-4d97-a934-a3ddfed95cd0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046237 Aug 05 02:28:24.503940 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 472/939] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:28:24 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:28:25.024304 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-419e4d5e-4511-469b-b49d-9804b2372260 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:25.024938 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-419e4d5e-4511-469b-b49d-9804b2372260 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:25.031266 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-419e4d5e-4511-469b-b49d-9804b2372260 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:25.031747 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-419e4d5e-4511-469b-b49d-9804b2372260 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:25.032183 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-419e4d5e-4511-469b-b49d-9804b2372260 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:25.032903 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-419e4d5e-4511-469b-b49d-9804b2372260 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:25.033362 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-419e4d5e-4511-469b-b49d-9804b2372260 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:25.033787 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-419e4d5e-4511-469b-b49d-9804b2372260 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:25.162545 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-419e4d5e-4511-469b-b49d-9804b2372260 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:25.170343 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-419e4d5e-4511-469b-b49d-9804b2372260 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 200 len: 1319 microversion: 2.1 time: 0.149918 Aug 05 02:28:25.170904 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 468/940] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:25 2022] GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:25.515697 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-04313c9c-6f84-4d18-9fd1-4eb672001cd4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:25.518303 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-04313c9c-6f84-4d18-9fd1-4eb672001cd4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:25.526924 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04313c9c-6f84-4d18-9fd1-4eb672001cd4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:25.527425 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04313c9c-6f84-4d18-9fd1-4eb672001cd4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:25.527868 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04313c9c-6f84-4d18-9fd1-4eb672001cd4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:25.528595 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04313c9c-6f84-4d18-9fd1-4eb672001cd4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:25.529055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04313c9c-6f84-4d18-9fd1-4eb672001cd4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:25.529526 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04313c9c-6f84-4d18-9fd1-4eb672001cd4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:25.561997 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-04313c9c-6f84-4d18-9fd1-4eb672001cd4 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050655 Aug 05 02:28:25.562565 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 473/941] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:28:25 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:28:26.190714 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-186917cc-1ca6-45e8-803c-98b5d7f4f7f3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:26.191335 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-186917cc-1ca6-45e8-803c-98b5d7f4f7f3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:26.197766 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-186917cc-1ca6-45e8-803c-98b5d7f4f7f3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:26.198244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-186917cc-1ca6-45e8-803c-98b5d7f4f7f3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:26.198674 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-186917cc-1ca6-45e8-803c-98b5d7f4f7f3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:26.199358 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-186917cc-1ca6-45e8-803c-98b5d7f4f7f3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:26.199803 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-186917cc-1ca6-45e8-803c-98b5d7f4f7f3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:26.200220 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-186917cc-1ca6-45e8-803c-98b5d7f4f7f3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:26.338429 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-186917cc-1ca6-45e8-803c-98b5d7f4f7f3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:26.347156 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-186917cc-1ca6-45e8-803c-98b5d7f4f7f3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 200 len: 1319 microversion: 2.1 time: 0.160328 Aug 05 02:28:26.347727 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 469/942] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:26 2022] GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:26.574151 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1224007f-c723-4321-8156-1c86b4eb40be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:26.576384 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1224007f-c723-4321-8156-1c86b4eb40be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:26.583926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1224007f-c723-4321-8156-1c86b4eb40be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:26.584469 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1224007f-c723-4321-8156-1c86b4eb40be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:26.585165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1224007f-c723-4321-8156-1c86b4eb40be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:26.585602 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1224007f-c723-4321-8156-1c86b4eb40be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:26.586053 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1224007f-c723-4321-8156-1c86b4eb40be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:26.586742 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1224007f-c723-4321-8156-1c86b4eb40be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:26.590368 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:26.618404 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1224007f-c723-4321-8156-1c86b4eb40be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048148 Aug 05 02:28:26.618971 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 474/943] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:28:26 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 02:28:26.681098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-435c4035-95e1-440e-a658-af4f2515b9af tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:26.681591 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-435c4035-95e1-440e-a658-af4f2515b9af tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:26.688412 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-435c4035-95e1-440e-a658-af4f2515b9af tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:26.688897 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-435c4035-95e1-440e-a658-af4f2515b9af tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:26.689327 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-435c4035-95e1-440e-a658-af4f2515b9af tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:26.690007 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-435c4035-95e1-440e-a658-af4f2515b9af tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:26.690462 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-435c4035-95e1-440e-a658-af4f2515b9af tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:26.690878 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-435c4035-95e1-440e-a658-af4f2515b9af tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:26.719885 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-435c4035-95e1-440e-a658-af4f2515b9af tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:28:26.802589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-435c4035-95e1-440e-a658-af4f2515b9af tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "DELETE /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 204 len: 0 microversion: 2.1 time: 0.124965 Aug 05 02:28:26.803243 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 470/944] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:28:26 2022] DELETE /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 05 02:28:26.813775 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8dd23562-9770-4980-b606-27416aebb9a0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:26.814488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8dd23562-9770-4980-b606-27416aebb9a0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:26.822240 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dd23562-9770-4980-b606-27416aebb9a0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:26.822810 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dd23562-9770-4980-b606-27416aebb9a0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:26.823319 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dd23562-9770-4980-b606-27416aebb9a0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:26.824087 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dd23562-9770-4980-b606-27416aebb9a0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:26.824642 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dd23562-9770-4980-b606-27416aebb9a0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:26.825140 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8dd23562-9770-4980-b606-27416aebb9a0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:26.953725 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8dd23562-9770-4980-b606-27416aebb9a0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:26.961441 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8dd23562-9770-4980-b606-27416aebb9a0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1679 microversion: 2.1 time: 0.152230 Aug 05 02:28:26.962012 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 475/945] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:26 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:27.369426 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-dd0e74de-b770-4d75-a12c-f9476ace61f2 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:27.370218 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dd0e74de-b770-4d75-a12c-f9476ace61f2 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:27.376934 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dd0e74de-b770-4d75-a12c-f9476ace61f2 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:27.377419 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dd0e74de-b770-4d75-a12c-f9476ace61f2 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:27.377856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dd0e74de-b770-4d75-a12c-f9476ace61f2 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:27.378553 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dd0e74de-b770-4d75-a12c-f9476ace61f2 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:27.379007 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dd0e74de-b770-4d75-a12c-f9476ace61f2 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:27.379435 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dd0e74de-b770-4d75-a12c-f9476ace61f2 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:27.507784 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-dd0e74de-b770-4d75-a12c-f9476ace61f2 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:27.515360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-dd0e74de-b770-4d75-a12c-f9476ace61f2 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 200 len: 1319 microversion: 2.1 time: 0.150162 Aug 05 02:28:27.515918 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 471/946] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:27 2022] GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:27.983245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1c968929-9fac-43c7-8d0e-29d69f91ade0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:27.983850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1c968929-9fac-43c7-8d0e-29d69f91ade0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:27.990201 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c968929-9fac-43c7-8d0e-29d69f91ade0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:27.990675 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c968929-9fac-43c7-8d0e-29d69f91ade0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:27.991105 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c968929-9fac-43c7-8d0e-29d69f91ade0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:27.991782 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c968929-9fac-43c7-8d0e-29d69f91ade0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:27.992228 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c968929-9fac-43c7-8d0e-29d69f91ade0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:27.992675 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1c968929-9fac-43c7-8d0e-29d69f91ade0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:28.129454 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1c968929-9fac-43c7-8d0e-29d69f91ade0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:28.137170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1c968929-9fac-43c7-8d0e-29d69f91ade0 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1679 microversion: 2.1 time: 0.157888 Aug 05 02:28:28.137737 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 476/947] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:27 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:28.535325 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8827c27b-6dc0-450c-aba7-6e8cc5a1a317 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:28.535956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8827c27b-6dc0-450c-aba7-6e8cc5a1a317 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:28.542273 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8827c27b-6dc0-450c-aba7-6e8cc5a1a317 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:28.542754 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8827c27b-6dc0-450c-aba7-6e8cc5a1a317 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:28.543184 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8827c27b-6dc0-450c-aba7-6e8cc5a1a317 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:28.543866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8827c27b-6dc0-450c-aba7-6e8cc5a1a317 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:28.544314 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8827c27b-6dc0-450c-aba7-6e8cc5a1a317 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:28.544755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8827c27b-6dc0-450c-aba7-6e8cc5a1a317 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:28.678742 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8827c27b-6dc0-450c-aba7-6e8cc5a1a317 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:28.686354 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8827c27b-6dc0-450c-aba7-6e8cc5a1a317 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 200 len: 1319 microversion: 2.1 time: 0.154859 Aug 05 02:28:28.686919 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 472/948] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:28 2022] GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:28.747947 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-236b878d-f2a1-48d6-bcc3-148cb1280a0c req-ef9edeed-4890-402f-a773-5050c8146cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8f5d3f-23c3-4e26-a9e2-78c610209aa1", "name": "network-vif-plugged", "status": "completed", "tag": "66177fbd-6947-4a08-a7d0-b06472880f9f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:28:28.757880 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-236b878d-f2a1-48d6-bcc3-148cb1280a0c req-ef9edeed-4890-402f-a773-5050c8146cc1 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:28.758313 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-236b878d-f2a1-48d6-bcc3-148cb1280a0c req-ef9edeed-4890-402f-a773-5050c8146cc1 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:28.758775 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-236b878d-f2a1-48d6-bcc3-148cb1280a0c req-ef9edeed-4890-402f-a773-5050c8146cc1 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:28.770821 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-236b878d-f2a1-48d6-bcc3-148cb1280a0c req-ef9edeed-4890-402f-a773-5050c8146cc1 service nova] Creating event network-vif-plugged:66177fbd-6947-4a08-a7d0-b06472880f9f for instance bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 on hv-cinder-81558 Aug 05 02:28:28.775854 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-236b878d-f2a1-48d6-bcc3-148cb1280a0c req-ef9edeed-4890-402f-a773-5050c8146cc1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031636 Aug 05 02:28:28.776664 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 477/949] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:28:29.158958 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b7962e7d-2c99-46c4-ba92-f42b6c612e14 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:29.159489 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b7962e7d-2c99-46c4-ba92-f42b6c612e14 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:29.161438 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:29.162106 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:29.168645 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b7962e7d-2c99-46c4-ba92-f42b6c612e14 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:29.169130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b7962e7d-2c99-46c4-ba92-f42b6c612e14 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:29.170588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b7962e7d-2c99-46c4-ba92-f42b6c612e14 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:29.171453 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b7962e7d-2c99-46c4-ba92-f42b6c612e14 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:29.171917 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b7962e7d-2c99-46c4-ba92-f42b6c612e14 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:29.172365 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b7962e7d-2c99-46c4-ba92-f42b6c612e14 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:29.365311 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b7962e7d-2c99-46c4-ba92-f42b6c612e14 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:29.372729 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b7962e7d-2c99-46c4-ba92-f42b6c612e14 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1679 microversion: 2.1 time: 0.218355 Aug 05 02:28:29.373530 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 473/950] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:29 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1679 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:29.705608 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:29.709932 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b5a8bb2a-403a-49af-b308-7eb7fa5159d5 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:29.710635 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b5a8bb2a-403a-49af-b308-7eb7fa5159d5 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:29.717364 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5a8bb2a-403a-49af-b308-7eb7fa5159d5 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:29.717854 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5a8bb2a-403a-49af-b308-7eb7fa5159d5 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:29.718295 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5a8bb2a-403a-49af-b308-7eb7fa5159d5 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:29.718993 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5a8bb2a-403a-49af-b308-7eb7fa5159d5 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:29.719448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5a8bb2a-403a-49af-b308-7eb7fa5159d5 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:29.720093 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b5a8bb2a-403a-49af-b308-7eb7fa5159d5 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:29.855482 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b5a8bb2a-403a-49af-b308-7eb7fa5159d5 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:29.864224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b5a8bb2a-403a-49af-b308-7eb7fa5159d5 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 200 len: 1319 microversion: 2.1 time: 0.160014 Aug 05 02:28:29.864842 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 478/951] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:29 2022] GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:30.187545 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-f59541da-af80-487d-a7d4-20bb47a6bd92 req-ceafb64a-6d97-4d30-bf23-46f753162977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a74b7e-5eed-4b83-8abb-d300e6662c14", "name": "network-vif-deleted", "tag": "470a70cc-8420-4e3a-996b-d0527d557db3"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:28:30.199524 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f59541da-af80-487d-a7d4-20bb47a6bd92 req-ceafb64a-6d97-4d30-bf23-46f753162977 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:30.202300 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f59541da-af80-487d-a7d4-20bb47a6bd92 req-ceafb64a-6d97-4d30-bf23-46f753162977 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:30.202300 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f59541da-af80-487d-a7d4-20bb47a6bd92 req-ceafb64a-6d97-4d30-bf23-46f753162977 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:30.205203 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:30.217760 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-f59541da-af80-487d-a7d4-20bb47a6bd92 req-ceafb64a-6d97-4d30-bf23-46f753162977 service nova] Creating event network-vif-deleted:470a70cc-8420-4e3a-996b-d0527d557db3 for instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 on hv-cinder-81558 Aug 05 02:28:30.222966 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-f59541da-af80-487d-a7d4-20bb47a6bd92 req-ceafb64a-6d97-4d30-bf23-46f753162977 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040381 Aug 05 02:28:30.223554 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 474/952] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:28:30.393155 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4b433e4b-c555-4296-8eba-a6caad576a50 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:30.393975 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4b433e4b-c555-4296-8eba-a6caad576a50 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:30.399804 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b433e4b-c555-4296-8eba-a6caad576a50 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:30.400281 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b433e4b-c555-4296-8eba-a6caad576a50 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:30.400757 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b433e4b-c555-4296-8eba-a6caad576a50 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:30.401437 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b433e4b-c555-4296-8eba-a6caad576a50 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:30.401885 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b433e4b-c555-4296-8eba-a6caad576a50 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:30.402308 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b433e4b-c555-4296-8eba-a6caad576a50 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:30.464744 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b433e4b-c555-4296-8eba-a6caad576a50 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:30.473208 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4b433e4b-c555-4296-8eba-a6caad576a50 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1611 microversion: 2.1 time: 0.083987 Aug 05 02:28:30.473899 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 479/953] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:30 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1611 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:30.887640 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-df409e95-5c31-48c0-a767-4a7c8194affc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:30.889125 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-df409e95-5c31-48c0-a767-4a7c8194affc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:30.896683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df409e95-5c31-48c0-a767-4a7c8194affc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:30.897278 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df409e95-5c31-48c0-a767-4a7c8194affc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:30.897831 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df409e95-5c31-48c0-a767-4a7c8194affc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:30.898796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df409e95-5c31-48c0-a767-4a7c8194affc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:30.899377 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df409e95-5c31-48c0-a767-4a7c8194affc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:30.899937 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-df409e95-5c31-48c0-a767-4a7c8194affc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:31.041094 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-df409e95-5c31-48c0-a767-4a7c8194affc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:31.049123 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-df409e95-5c31-48c0-a767-4a7c8194affc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 200 len: 1319 microversion: 2.1 time: 0.167379 Aug 05 02:28:31.049681 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 475/954] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:30 2022] GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:31.494942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c865af08-0190-429c-a75d-0dbf979ed606 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:31.495559 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c865af08-0190-429c-a75d-0dbf979ed606 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:31.502078 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c865af08-0190-429c-a75d-0dbf979ed606 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:31.502565 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c865af08-0190-429c-a75d-0dbf979ed606 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:31.503004 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c865af08-0190-429c-a75d-0dbf979ed606 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:31.503697 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c865af08-0190-429c-a75d-0dbf979ed606 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:31.504151 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c865af08-0190-429c-a75d-0dbf979ed606 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:31.504604 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c865af08-0190-429c-a75d-0dbf979ed606 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:31.536872 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c865af08-0190-429c-a75d-0dbf979ed606 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:31.537352 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c865af08-0190-429c-a75d-0dbf979ed606 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:31.537787 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c865af08-0190-429c-a75d-0dbf979ed606 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:31.538241 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-c865af08-0190-429c-a75d-0dbf979ed606 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lazy-loading 'fault' on Instance uuid 17a74b7e-5eed-4b83-8abb-d300e6662c14 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:28:31.582764 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c865af08-0190-429c-a75d-0dbf979ed606 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:31.590378 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c865af08-0190-429c-a75d-0dbf979ed606 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 200 len: 1329 microversion: 2.1 time: 0.099435 Aug 05 02:28:31.590941 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 480/955] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:31 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 1329 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:32.071751 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-70187a81-1669-406f-a544-8b38a7e59f83 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:32.072403 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-70187a81-1669-406f-a544-8b38a7e59f83 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:32.078993 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70187a81-1669-406f-a544-8b38a7e59f83 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:32.079463 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70187a81-1669-406f-a544-8b38a7e59f83 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:32.079924 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70187a81-1669-406f-a544-8b38a7e59f83 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:32.080725 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70187a81-1669-406f-a544-8b38a7e59f83 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:32.081249 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70187a81-1669-406f-a544-8b38a7e59f83 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:32.081718 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-70187a81-1669-406f-a544-8b38a7e59f83 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:32.289653 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-70187a81-1669-406f-a544-8b38a7e59f83 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:32.297943 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-70187a81-1669-406f-a544-8b38a7e59f83 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 200 len: 1507 microversion: 2.1 time: 0.231197 Aug 05 02:28:32.298508 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 476/956] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:32 2022] GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:32.611953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aa1acaab-dbdf-4b31-bc2d-613b493d0e37 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:32.612683 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aa1acaab-dbdf-4b31-bc2d-613b493d0e37 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:32.619527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa1acaab-dbdf-4b31-bc2d-613b493d0e37 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:32.620044 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa1acaab-dbdf-4b31-bc2d-613b493d0e37 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:32.620500 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa1acaab-dbdf-4b31-bc2d-613b493d0e37 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:32.621204 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa1acaab-dbdf-4b31-bc2d-613b493d0e37 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:32.621656 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa1acaab-dbdf-4b31-bc2d-613b493d0e37 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:32.622446 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa1acaab-dbdf-4b31-bc2d-613b493d0e37 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:32.637531 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-aa1acaab-dbdf-4b31-bc2d-613b493d0e37 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] HTTP exception thrown: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aa1acaab-dbdf-4b31-bc2d-613b493d0e37 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Request method failure captured: Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 HTTP/1.1 Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5pSyPEti3j-9gLBxlgA1L_GuWB6iJvenWVBmfr31mrg4vu4HTgr4mx0c2q3ZmjrMdxdtLzCg8wRia849DSEc7AfP2crmxulEg45Cq3I2oORZ75mc5ksg7ZmJKJ4cA2qZbyq7NZRhJeqx1H2xWUpibdSGnuQ0avaMqjO9VbCjnpzbo Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:28:32.639170 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:28:32.641234 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ad6a220b99d94a648150476bf0a01e50", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}] Aug 05 02:28:32.641234 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:28:32.641234 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:28:32.641234 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:28:32.641234 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:28:32.641234 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:28:32.641234 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:28:32.641234 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 600f51be8202427fb3691db566ed2ff2 Aug 05 02:28:32.641234 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:28:32.641234 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:28:32.641234 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. Aug 05 02:28:32.641234 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '17a74b7e-5eed-4b83-8abb-d300e6662c14'} Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:28:32.642146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. Aug 05 02:28:32.643480 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:28:32.644834 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aa1acaab-dbdf-4b31-bc2d-613b493d0e37 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Returning 404 to user: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:28:32.644834 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aa1acaab-dbdf-4b31-bc2d-613b493d0e37 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 404 len: 111 microversion: 2.1 time: 0.033402 Aug 05 02:28:32.644834 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 481/957] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:32 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 02:28:32.650710 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7153b079-15e0-4b18-bc4a-ac8af7647ef9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '.version_select at 0x7fa65c68c4c0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:32.669465 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7153b079-15e0-4b18-bc4a-ac8af7647ef9 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-31622562" status: 202 len: 0 microversion: 2.1 time: 0.022625 Aug 05 02:28:32.670012 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 477/958] 10.222.0.15 () {58 vars in 1215 bytes} [Fri Aug 5 02:28:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-31622562 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 02:28:33.587158 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8c0226ba-4f65-430d-9c8d-abdae6dfe1fc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Action: 'create', calling method: .version_select at 0x7fa65c4eb790>, body: {"keypair": {"name": "tempest-keypair-1847034072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzC07cB80jigtgegaqCiYnDlFPFGKOXwOeZ8O5uUZtLlFsBAj4XBMXeYsZY6lV/urAF/e8nkCHwPyg0+q3Wp3JXDmg+Vva1PIcFULk4yZ2urHQwaOqL+IeezdGQpi5gAA=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:28:33.602256 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-8c0226ba-4f65-430d-9c8d-abdae6dfe1fc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Getting quotas for project ad6a220b99d94a648150476bf0a01e50. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:28:33.606064 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-8c0226ba-4f65-430d-9c8d-abdae6dfe1fc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Getting quotas for user 600f51be8202427fb3691db566ed2ff2 and project ad6a220b99d94a648150476bf0a01e50. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:28:33.631330 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8c0226ba-4f65-430d-9c8d-abdae6dfe1fc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048217 Aug 05 02:28:33.632001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 482/959] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Aug 5 02:28:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:28:34.950566 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-315784474", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "528bd4e2-8ce2-403c-8a20-be166348ecb8"}], "security_groups": [{"name": "tempest-securitygroup--1398948362"}], "key_name": "tempest-keypair-1847034072", "user_data": "}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:28:35.062295 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] validate_networks() for [('528bd4e2-8ce2-403c-8a20-be166348ecb8', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:28:35.448087 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:28:35.448537 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:28:35.449006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:28:35.449436 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:28:35.449842 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:28:35.459054 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:35.459563 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:35.459992 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:35.460752 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:35.461468 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:35.461887 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:35.479029 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Getting quotas for project ad6a220b99d94a648150476bf0a01e50. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:28:35.482940 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Getting quotas for user 600f51be8202427fb3691db566ed2ff2 and project ad6a220b99d94a648150476bf0a01e50. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:28:35.493709 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:28:35.495963 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:28:35.544358 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7f634ac4-9bde-4876-bcb3-545646e8dc83 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.600668 Aug 05 02:28:35.545051 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 478/960] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:28:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:28:35.556527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ed107084-489d-412a-b3fb-a2395af961ba tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:35.557228 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ed107084-489d-412a-b3fb-a2395af961ba tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:35.611685 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ed107084-489d-412a-b3fb-a2395af961ba tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:35.619792 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ed107084-489d-412a-b3fb-a2395af961ba tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 200 len: 1241 microversion: 2.1 time: 0.067590 Aug 05 02:28:35.622763 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 483/961] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:35 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:36.643192 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c7208056-0823-4dcc-9e8b-5f0cf67be067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:36.643715 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c7208056-0823-4dcc-9e8b-5f0cf67be067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:36.650170 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7208056-0823-4dcc-9e8b-5f0cf67be067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:36.650647 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7208056-0823-4dcc-9e8b-5f0cf67be067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:36.651079 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7208056-0823-4dcc-9e8b-5f0cf67be067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:36.651762 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7208056-0823-4dcc-9e8b-5f0cf67be067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:36.652210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7208056-0823-4dcc-9e8b-5f0cf67be067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:36.652663 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c7208056-0823-4dcc-9e8b-5f0cf67be067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:36.715739 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c7208056-0823-4dcc-9e8b-5f0cf67be067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:36.724275 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c7208056-0823-4dcc-9e8b-5f0cf67be067 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 200 len: 1293 microversion: 2.1 time: 0.085097 Aug 05 02:28:36.724900 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 479/962] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:36 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:37.746475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5f51bce4-16af-4745-a2b8-2a21eeb9d129 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:37.747743 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5f51bce4-16af-4745-a2b8-2a21eeb9d129 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:37.755827 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f51bce4-16af-4745-a2b8-2a21eeb9d129 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:37.756379 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f51bce4-16af-4745-a2b8-2a21eeb9d129 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:37.756776 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f51bce4-16af-4745-a2b8-2a21eeb9d129 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:37.757661 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f51bce4-16af-4745-a2b8-2a21eeb9d129 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:37.758111 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f51bce4-16af-4745-a2b8-2a21eeb9d129 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:37.758536 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5f51bce4-16af-4745-a2b8-2a21eeb9d129 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:37.911895 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5f51bce4-16af-4745-a2b8-2a21eeb9d129 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:37.919394 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5f51bce4-16af-4745-a2b8-2a21eeb9d129 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 200 len: 1367 microversion: 2.1 time: 0.176733 Aug 05 02:28:37.919958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 484/963] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:37 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:38.328666 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-22ea50f6-6ec4-4d58-8a11-8b184fdcb6de req-4a63f770-008e-4bd1-9290-2bc78456a44f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d0e67c-0e2b-400b-a334-b8d2fcd0758a", "tag": "4d4a4290-997a-4edf-84d1-d7b7d68048c0"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:28:38.340672 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-22ea50f6-6ec4-4d58-8a11-8b184fdcb6de req-4a63f770-008e-4bd1-9290-2bc78456a44f service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:38.341185 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-22ea50f6-6ec4-4d58-8a11-8b184fdcb6de req-4a63f770-008e-4bd1-9290-2bc78456a44f service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:38.341627 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-22ea50f6-6ec4-4d58-8a11-8b184fdcb6de req-4a63f770-008e-4bd1-9290-2bc78456a44f service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:38.353623 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-22ea50f6-6ec4-4d58-8a11-8b184fdcb6de req-4a63f770-008e-4bd1-9290-2bc78456a44f service nova] Creating event network-changed:4d4a4290-997a-4edf-84d1-d7b7d68048c0 for instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a on hv-cinder-81558 Aug 05 02:28:38.358555 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-22ea50f6-6ec4-4d58-8a11-8b184fdcb6de req-4a63f770-008e-4bd1-9290-2bc78456a44f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033789 Aug 05 02:28:38.359664 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 480/964] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:28:38.940782 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a063c4b8-aa5e-4322-810f-4f461ca96e12 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:38.941394 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a063c4b8-aa5e-4322-810f-4f461ca96e12 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:38.948196 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a063c4b8-aa5e-4322-810f-4f461ca96e12 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:38.948729 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a063c4b8-aa5e-4322-810f-4f461ca96e12 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:38.949167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a063c4b8-aa5e-4322-810f-4f461ca96e12 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:38.949860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a063c4b8-aa5e-4322-810f-4f461ca96e12 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:38.950316 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a063c4b8-aa5e-4322-810f-4f461ca96e12 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:38.950741 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a063c4b8-aa5e-4322-810f-4f461ca96e12 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:38.970064 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-24854211-3871-4d54-ae53-55715c52fee6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:38.970637 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-24854211-3871-4d54-ae53-55715c52fee6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:38.976858 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24854211-3871-4d54-ae53-55715c52fee6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:38.977332 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24854211-3871-4d54-ae53-55715c52fee6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:38.977763 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24854211-3871-4d54-ae53-55715c52fee6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:38.978444 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24854211-3871-4d54-ae53-55715c52fee6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:38.978895 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24854211-3871-4d54-ae53-55715c52fee6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:38.979310 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-24854211-3871-4d54-ae53-55715c52fee6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:39.003069 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-24854211-3871-4d54-ae53-55715c52fee6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1/ips" status: 200 len: 151 microversion: 2.20 time: 0.037947 Aug 05 02:28:39.003669 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 481/965] 10.222.0.15 () {60 vars in 1289 bytes} [Fri Aug 5 02:28:38 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 02:28:39.095469 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a063c4b8-aa5e-4322-810f-4f461ca96e12 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:39.102859 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a063c4b8-aa5e-4322-810f-4f461ca96e12 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 200 len: 1367 microversion: 2.1 time: 0.166005 Aug 05 02:28:39.103419 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 485/966] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:38 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:40.123060 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3671fe9c-cbc7-4130-bdf4-a4063dfd8317 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:40.123736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3671fe9c-cbc7-4130-bdf4-a4063dfd8317 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:40.131077 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3671fe9c-cbc7-4130-bdf4-a4063dfd8317 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:40.131689 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3671fe9c-cbc7-4130-bdf4-a4063dfd8317 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:40.132405 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3671fe9c-cbc7-4130-bdf4-a4063dfd8317 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:40.133732 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3671fe9c-cbc7-4130-bdf4-a4063dfd8317 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:40.134402 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3671fe9c-cbc7-4130-bdf4-a4063dfd8317 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:40.134964 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3671fe9c-cbc7-4130-bdf4-a4063dfd8317 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:40.272357 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3671fe9c-cbc7-4130-bdf4-a4063dfd8317 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:40.279895 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3671fe9c-cbc7-4130-bdf4-a4063dfd8317 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 200 len: 1367 microversion: 2.1 time: 0.160820 Aug 05 02:28:40.283661 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 482/967] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:40 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:40.875920 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bd0a809b-e832-466c-9820-d89f116c4001 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:28:40.876500 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bd0a809b-e832-466c-9820-d89f116c4001 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:40.882863 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd0a809b-e832-466c-9820-d89f116c4001 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:40.883342 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd0a809b-e832-466c-9820-d89f116c4001 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:40.883775 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd0a809b-e832-466c-9820-d89f116c4001 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:40.884490 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd0a809b-e832-466c-9820-d89f116c4001 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:40.884962 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd0a809b-e832-466c-9820-d89f116c4001 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:40.885361 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bd0a809b-e832-466c-9820-d89f116c4001 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:40.908654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-bd0a809b-e832-466c-9820-d89f116c4001 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lazy-loading 'flavor' on Instance uuid ac84bba5-1a3a-4625-ad22-276df81d03a1 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:28:41.086278 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bd0a809b-e832-466c-9820-d89f116c4001 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "POST /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1/action" status: 202 len: 0 microversion: 2.20 time: 0.214286 Aug 05 02:28:41.086809 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 486/968] 10.222.0.15 () {62 vars in 1319 bytes} [Fri Aug 5 02:28:40 2022] POST /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:28:41.095056 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0baead5e-7d72-44f4-8783-6edbcfed05cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:41.095710 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0baead5e-7d72-44f4-8783-6edbcfed05cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:41.101940 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0baead5e-7d72-44f4-8783-6edbcfed05cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:41.102510 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0baead5e-7d72-44f4-8783-6edbcfed05cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:41.103071 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0baead5e-7d72-44f4-8783-6edbcfed05cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:41.103754 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0baead5e-7d72-44f4-8783-6edbcfed05cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:41.104125 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0baead5e-7d72-44f4-8783-6edbcfed05cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:41.104569 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0baead5e-7d72-44f4-8783-6edbcfed05cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:41.238755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0baead5e-7d72-44f4-8783-6edbcfed05cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:41.247359 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0baead5e-7d72-44f4-8783-6edbcfed05cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:41.248893 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0baead5e-7d72-44f4-8783-6edbcfed05cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:41.250869 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0baead5e-7d72-44f4-8783-6edbcfed05cb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.159854 Aug 05 02:28:41.251797 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 483/969] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:41 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:28:41.302388 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-28e9f562-cbb1-4ead-9290-53ea11221fcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:41.303072 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-28e9f562-cbb1-4ead-9290-53ea11221fcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:41.309252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28e9f562-cbb1-4ead-9290-53ea11221fcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:41.309728 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28e9f562-cbb1-4ead-9290-53ea11221fcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:41.310157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28e9f562-cbb1-4ead-9290-53ea11221fcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:41.310836 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28e9f562-cbb1-4ead-9290-53ea11221fcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:41.311281 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28e9f562-cbb1-4ead-9290-53ea11221fcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:41.311697 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28e9f562-cbb1-4ead-9290-53ea11221fcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:41.449630 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-28e9f562-cbb1-4ead-9290-53ea11221fcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:41.457002 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-28e9f562-cbb1-4ead-9290-53ea11221fcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 200 len: 1367 microversion: 2.1 time: 0.158833 Aug 05 02:28:41.457592 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 487/970] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:41 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:42.275195 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9d731a93-167d-47a1-8c4a-59f1de1f1368 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:42.275804 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9d731a93-167d-47a1-8c4a-59f1de1f1368 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:42.282638 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9d731a93-167d-47a1-8c4a-59f1de1f1368 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:42.283240 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9d731a93-167d-47a1-8c4a-59f1de1f1368 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:42.283672 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9d731a93-167d-47a1-8c4a-59f1de1f1368 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:42.284392 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9d731a93-167d-47a1-8c4a-59f1de1f1368 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:42.284843 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9d731a93-167d-47a1-8c4a-59f1de1f1368 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:42.285262 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9d731a93-167d-47a1-8c4a-59f1de1f1368 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:42.464472 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9d731a93-167d-47a1-8c4a-59f1de1f1368 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:42.475334 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9d731a93-167d-47a1-8c4a-59f1de1f1368 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:42.476862 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9d731a93-167d-47a1-8c4a-59f1de1f1368 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:42.478017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9d731a93-167d-47a1-8c4a-59f1de1f1368 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.207658 Aug 05 02:28:42.478442 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-961301e4-bf06-43a8-8673-11dcd4db4c05 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:42.478900 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 484/971] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:42 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:28:42.479303 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-961301e4-bf06-43a8-8673-11dcd4db4c05 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:42.486987 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-961301e4-bf06-43a8-8673-11dcd4db4c05 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:42.487468 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-961301e4-bf06-43a8-8673-11dcd4db4c05 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:42.487903 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-961301e4-bf06-43a8-8673-11dcd4db4c05 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:42.488639 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-961301e4-bf06-43a8-8673-11dcd4db4c05 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:42.489123 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-961301e4-bf06-43a8-8673-11dcd4db4c05 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:42.489548 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-961301e4-bf06-43a8-8673-11dcd4db4c05 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:42.769021 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-961301e4-bf06-43a8-8673-11dcd4db4c05 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:42.776585 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-961301e4-bf06-43a8-8673-11dcd4db4c05 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 200 len: 1367 microversion: 2.1 time: 0.302170 Aug 05 02:28:42.777231 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 488/972] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:42 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:28:43.501282 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-01134816-cc9d-4344-9743-b868d2e8653d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:43.501894 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-01134816-cc9d-4344-9743-b868d2e8653d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:43.508235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01134816-cc9d-4344-9743-b868d2e8653d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:43.508758 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01134816-cc9d-4344-9743-b868d2e8653d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:43.509197 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01134816-cc9d-4344-9743-b868d2e8653d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:43.509891 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01134816-cc9d-4344-9743-b868d2e8653d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:43.510342 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01134816-cc9d-4344-9743-b868d2e8653d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:43.510768 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-01134816-cc9d-4344-9743-b868d2e8653d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:43.640948 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-01134816-cc9d-4344-9743-b868d2e8653d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:43.650062 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-01134816-cc9d-4344-9743-b868d2e8653d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:43.651508 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-01134816-cc9d-4344-9743-b868d2e8653d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:43.652690 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-01134816-cc9d-4344-9743-b868d2e8653d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.155350 Aug 05 02:28:43.653249 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 485/973] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:43 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:28:43.796906 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-54cf7aaf-1127-441c-82b6-80d794102bcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:43.797517 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-54cf7aaf-1127-441c-82b6-80d794102bcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:43.804013 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54cf7aaf-1127-441c-82b6-80d794102bcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:43.804531 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54cf7aaf-1127-441c-82b6-80d794102bcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:43.804965 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54cf7aaf-1127-441c-82b6-80d794102bcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:43.805648 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54cf7aaf-1127-441c-82b6-80d794102bcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:43.806097 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54cf7aaf-1127-441c-82b6-80d794102bcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:43.806522 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-54cf7aaf-1127-441c-82b6-80d794102bcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:43.932595 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-54cf7aaf-1127-441c-82b6-80d794102bcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:43.942408 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-54cf7aaf-1127-441c-82b6-80d794102bcc tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 200 len: 1367 microversion: 2.1 time: 0.149324 Aug 05 02:28:43.942972 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 489/974] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:43 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:44.676562 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d7b9654c-7483-477d-8577-0939ef2e62a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:44.677535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d7b9654c-7483-477d-8577-0939ef2e62a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:44.683535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d7b9654c-7483-477d-8577-0939ef2e62a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:44.684021 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d7b9654c-7483-477d-8577-0939ef2e62a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:44.684491 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d7b9654c-7483-477d-8577-0939ef2e62a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:44.685192 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d7b9654c-7483-477d-8577-0939ef2e62a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:44.685647 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d7b9654c-7483-477d-8577-0939ef2e62a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:44.686068 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d7b9654c-7483-477d-8577-0939ef2e62a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:44.827412 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d7b9654c-7483-477d-8577-0939ef2e62a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:44.840271 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d7b9654c-7483-477d-8577-0939ef2e62a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:44.841960 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d7b9654c-7483-477d-8577-0939ef2e62a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:44.843251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d7b9654c-7483-477d-8577-0939ef2e62a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.171505 Aug 05 02:28:44.843809 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 486/975] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:44 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:28:44.963835 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8b325dad-5957-474e-b179-cafcddad1674 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:44.964591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8b325dad-5957-474e-b179-cafcddad1674 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:44.971155 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b325dad-5957-474e-b179-cafcddad1674 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:44.971716 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b325dad-5957-474e-b179-cafcddad1674 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:44.972225 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b325dad-5957-474e-b179-cafcddad1674 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:44.973037 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b325dad-5957-474e-b179-cafcddad1674 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:44.973559 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b325dad-5957-474e-b179-cafcddad1674 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:44.974064 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b325dad-5957-474e-b179-cafcddad1674 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:44.990041 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-4b6eb5a9-5337-4b07-9130-c43230cdb1f2 req-2e8da78e-b193-4887-9113-a05b470902f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d0e67c-0e2b-400b-a334-b8d2fcd0758a", "name": "network-vif-plugged", "status": "completed", "tag": "4d4a4290-997a-4edf-84d1-d7b7d68048c0"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:28:45.000373 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4b6eb5a9-5337-4b07-9130-c43230cdb1f2 req-2e8da78e-b193-4887-9113-a05b470902f1 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:45.001397 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4b6eb5a9-5337-4b07-9130-c43230cdb1f2 req-2e8da78e-b193-4887-9113-a05b470902f1 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:45.002157 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-4b6eb5a9-5337-4b07-9130-c43230cdb1f2 req-2e8da78e-b193-4887-9113-a05b470902f1 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:45.013924 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-4b6eb5a9-5337-4b07-9130-c43230cdb1f2 req-2e8da78e-b193-4887-9113-a05b470902f1 service nova] Creating event network-vif-plugged:4d4a4290-997a-4edf-84d1-d7b7d68048c0 for instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a on hv-cinder-81558 Aug 05 02:28:45.018883 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-4b6eb5a9-5337-4b07-9130-c43230cdb1f2 req-2e8da78e-b193-4887-9113-a05b470902f1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033480 Aug 05 02:28:45.019865 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 487/976] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:28:45.111718 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8b325dad-5957-474e-b179-cafcddad1674 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:45.119388 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8b325dad-5957-474e-b179-cafcddad1674 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 200 len: 1367 microversion: 2.1 time: 0.159690 Aug 05 02:28:45.119947 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 490/977] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:44 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:45.864983 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:45.865856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:45.870466 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-08222231-33e2-4a52-b6cb-7d72dd51df2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:45.871162 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-08222231-33e2-4a52-b6cb-7d72dd51df2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:45.878667 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-08222231-33e2-4a52-b6cb-7d72dd51df2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:45.879148 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-08222231-33e2-4a52-b6cb-7d72dd51df2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:45.879580 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-08222231-33e2-4a52-b6cb-7d72dd51df2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:45.880263 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-08222231-33e2-4a52-b6cb-7d72dd51df2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:45.880741 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-08222231-33e2-4a52-b6cb-7d72dd51df2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:45.881161 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-08222231-33e2-4a52-b6cb-7d72dd51df2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:46.013353 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-08222231-33e2-4a52-b6cb-7d72dd51df2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:46.021241 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-08222231-33e2-4a52-b6cb-7d72dd51df2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:46.022720 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-08222231-33e2-4a52-b6cb-7d72dd51df2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:46.023865 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-08222231-33e2-4a52-b6cb-7d72dd51df2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.159868 Aug 05 02:28:46.024454 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 488/978] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:45 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:28:46.139968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cc2d0e70-e90d-4f78-ad9b-13eebbd80815 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:46.140592 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cc2d0e70-e90d-4f78-ad9b-13eebbd80815 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:46.142610 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:46.148227 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc2d0e70-e90d-4f78-ad9b-13eebbd80815 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:46.148707 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc2d0e70-e90d-4f78-ad9b-13eebbd80815 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:46.149138 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc2d0e70-e90d-4f78-ad9b-13eebbd80815 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:46.149813 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc2d0e70-e90d-4f78-ad9b-13eebbd80815 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:46.150262 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc2d0e70-e90d-4f78-ad9b-13eebbd80815 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:46.150679 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc2d0e70-e90d-4f78-ad9b-13eebbd80815 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:46.279420 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cc2d0e70-e90d-4f78-ad9b-13eebbd80815 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:46.281629 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:46.289047 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cc2d0e70-e90d-4f78-ad9b-13eebbd80815 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 200 len: 1367 microversion: 2.1 time: 0.153151 Aug 05 02:28:46.289598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 491/979] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:46 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:47.047099 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f3f2d5c5-2855-4cf7-8569-fa6759f89bb3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:47.047684 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f3f2d5c5-2855-4cf7-8569-fa6759f89bb3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:47.054186 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3f2d5c5-2855-4cf7-8569-fa6759f89bb3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:47.054674 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3f2d5c5-2855-4cf7-8569-fa6759f89bb3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:47.055108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3f2d5c5-2855-4cf7-8569-fa6759f89bb3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:47.055803 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3f2d5c5-2855-4cf7-8569-fa6759f89bb3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:47.056257 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3f2d5c5-2855-4cf7-8569-fa6759f89bb3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:47.056711 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f3f2d5c5-2855-4cf7-8569-fa6759f89bb3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:47.182833 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f3f2d5c5-2855-4cf7-8569-fa6759f89bb3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:47.190899 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f3f2d5c5-2855-4cf7-8569-fa6759f89bb3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:47.192441 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f3f2d5c5-2855-4cf7-8569-fa6759f89bb3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:47.193601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f3f2d5c5-2855-4cf7-8569-fa6759f89bb3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.150546 Aug 05 02:28:47.194150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 489/980] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:47 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:28:47.310134 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c74f5a7a-e290-4412-b32a-d5ed55e589d7 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:47.310678 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c74f5a7a-e290-4412-b32a-d5ed55e589d7 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:47.318964 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c74f5a7a-e290-4412-b32a-d5ed55e589d7 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:47.319447 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c74f5a7a-e290-4412-b32a-d5ed55e589d7 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:47.319880 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c74f5a7a-e290-4412-b32a-d5ed55e589d7 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:47.320595 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c74f5a7a-e290-4412-b32a-d5ed55e589d7 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:47.321046 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c74f5a7a-e290-4412-b32a-d5ed55e589d7 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:47.321467 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c74f5a7a-e290-4412-b32a-d5ed55e589d7 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:47.451597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c74f5a7a-e290-4412-b32a-d5ed55e589d7 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:47.459496 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c74f5a7a-e290-4412-b32a-d5ed55e589d7 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 200 len: 1557 microversion: 2.1 time: 0.154105 Aug 05 02:28:47.460054 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 492/981] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:28:47 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:28:47.481030 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-62c3573c-d4a1-45cd-8f20-33857a97d23c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:47.481542 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-62c3573c-d4a1-45cd-8f20-33857a97d23c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:47.488146 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62c3573c-d4a1-45cd-8f20-33857a97d23c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:47.488664 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62c3573c-d4a1-45cd-8f20-33857a97d23c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:47.489104 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62c3573c-d4a1-45cd-8f20-33857a97d23c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:47.489797 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62c3573c-d4a1-45cd-8f20-33857a97d23c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:47.490252 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62c3573c-d4a1-45cd-8f20-33857a97d23c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:47.490682 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-62c3573c-d4a1-45cd-8f20-33857a97d23c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:47.566623 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-62c3573c-d4a1-45cd-8f20-33857a97d23c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089523 Aug 05 02:28:47.567215 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 490/982] 10.222.0.15 () {58 vars in 1275 bytes} [Fri Aug 5 02:28:47 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:28:48.217201 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e523193e-9bdc-45a9-a4ae-c5bee9b72254 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:48.217808 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e523193e-9bdc-45a9-a4ae-c5bee9b72254 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:48.224140 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e523193e-9bdc-45a9-a4ae-c5bee9b72254 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:48.224580 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e523193e-9bdc-45a9-a4ae-c5bee9b72254 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:48.225701 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e523193e-9bdc-45a9-a4ae-c5bee9b72254 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:48.226403 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e523193e-9bdc-45a9-a4ae-c5bee9b72254 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:48.226854 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e523193e-9bdc-45a9-a4ae-c5bee9b72254 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:48.227275 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e523193e-9bdc-45a9-a4ae-c5bee9b72254 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:48.362291 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e523193e-9bdc-45a9-a4ae-c5bee9b72254 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:48.370295 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e523193e-9bdc-45a9-a4ae-c5bee9b72254 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:48.371779 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e523193e-9bdc-45a9-a4ae-c5bee9b72254 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:48.372947 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e523193e-9bdc-45a9-a4ae-c5bee9b72254 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.159674 Aug 05 02:28:48.373495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 493/983] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:48 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:28:48.764908 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-f0f0ec06-52ce-4961-adce-ace7ff7a1ffd req-b1cbee5e-571b-4fbd-87b0-7ba353ff89f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d0e67c-0e2b-400b-a334-b8d2fcd0758a", "tag": "4d4a4290-997a-4edf-84d1-d7b7d68048c0"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:28:48.774734 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f0f0ec06-52ce-4961-adce-ace7ff7a1ffd req-b1cbee5e-571b-4fbd-87b0-7ba353ff89f1 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:48.775208 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f0f0ec06-52ce-4961-adce-ace7ff7a1ffd req-b1cbee5e-571b-4fbd-87b0-7ba353ff89f1 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:48.775635 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f0f0ec06-52ce-4961-adce-ace7ff7a1ffd req-b1cbee5e-571b-4fbd-87b0-7ba353ff89f1 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:48.787295 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-f0f0ec06-52ce-4961-adce-ace7ff7a1ffd req-b1cbee5e-571b-4fbd-87b0-7ba353ff89f1 service nova] Creating event network-changed:4d4a4290-997a-4edf-84d1-d7b7d68048c0 for instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a on hv-cinder-81558 Aug 05 02:28:48.792115 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-f0f0ec06-52ce-4961-adce-ace7ff7a1ffd req-b1cbee5e-571b-4fbd-87b0-7ba353ff89f1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031428 Aug 05 02:28:48.792976 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 491/984] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:28:49.398543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9fb0d46c-1c23-4df3-b4b8-62fb7323d386 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:49.399154 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9fb0d46c-1c23-4df3-b4b8-62fb7323d386 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:49.405549 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9fb0d46c-1c23-4df3-b4b8-62fb7323d386 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:49.406033 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9fb0d46c-1c23-4df3-b4b8-62fb7323d386 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:49.406471 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9fb0d46c-1c23-4df3-b4b8-62fb7323d386 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:49.407763 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9fb0d46c-1c23-4df3-b4b8-62fb7323d386 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:49.408227 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9fb0d46c-1c23-4df3-b4b8-62fb7323d386 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:49.408678 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9fb0d46c-1c23-4df3-b4b8-62fb7323d386 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:49.540398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9fb0d46c-1c23-4df3-b4b8-62fb7323d386 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:49.549420 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9fb0d46c-1c23-4df3-b4b8-62fb7323d386 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:49.550879 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9fb0d46c-1c23-4df3-b4b8-62fb7323d386 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:49.552054 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9fb0d46c-1c23-4df3-b4b8-62fb7323d386 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.158720 Aug 05 02:28:49.552672 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 494/985] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:49 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:28:50.576992 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e16b1bc6-707a-4485-b34f-c2b2f7a0a48c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:50.577616 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e16b1bc6-707a-4485-b34f-c2b2f7a0a48c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:50.584597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e16b1bc6-707a-4485-b34f-c2b2f7a0a48c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:50.585066 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e16b1bc6-707a-4485-b34f-c2b2f7a0a48c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:50.585491 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e16b1bc6-707a-4485-b34f-c2b2f7a0a48c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:50.586417 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e16b1bc6-707a-4485-b34f-c2b2f7a0a48c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:50.586862 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e16b1bc6-707a-4485-b34f-c2b2f7a0a48c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:50.587277 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e16b1bc6-707a-4485-b34f-c2b2f7a0a48c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:50.720643 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e16b1bc6-707a-4485-b34f-c2b2f7a0a48c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:50.728448 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e16b1bc6-707a-4485-b34f-c2b2f7a0a48c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:50.729926 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e16b1bc6-707a-4485-b34f-c2b2f7a0a48c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:50.731085 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e16b1bc6-707a-4485-b34f-c2b2f7a0a48c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.159174 Aug 05 02:28:50.731631 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 492/986] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:50 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:28:51.754677 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-53447409-2237-4394-8267-a7eb8863e498 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:51.755289 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-53447409-2237-4394-8267-a7eb8863e498 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:51.761683 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53447409-2237-4394-8267-a7eb8863e498 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:51.762167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53447409-2237-4394-8267-a7eb8863e498 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:51.762605 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53447409-2237-4394-8267-a7eb8863e498 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:51.763301 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53447409-2237-4394-8267-a7eb8863e498 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:51.763754 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53447409-2237-4394-8267-a7eb8863e498 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:51.764183 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53447409-2237-4394-8267-a7eb8863e498 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:51.896999 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-53447409-2237-4394-8267-a7eb8863e498 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:51.904810 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-53447409-2237-4394-8267-a7eb8863e498 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:51.906290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-53447409-2237-4394-8267-a7eb8863e498 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:51.908060 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-53447409-2237-4394-8267-a7eb8863e498 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.157927 Aug 05 02:28:51.908661 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 495/987] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:51 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:28:52.931186 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3d1fe29b-0367-4011-9a9e-e92d84196d36 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:52.931785 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3d1fe29b-0367-4011-9a9e-e92d84196d36 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:52.938701 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d1fe29b-0367-4011-9a9e-e92d84196d36 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:52.939186 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d1fe29b-0367-4011-9a9e-e92d84196d36 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:52.939610 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d1fe29b-0367-4011-9a9e-e92d84196d36 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:52.940285 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d1fe29b-0367-4011-9a9e-e92d84196d36 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:52.940766 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d1fe29b-0367-4011-9a9e-e92d84196d36 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:52.941182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d1fe29b-0367-4011-9a9e-e92d84196d36 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:53.074068 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3d1fe29b-0367-4011-9a9e-e92d84196d36 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:53.082279 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3d1fe29b-0367-4011-9a9e-e92d84196d36 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:53.083778 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3d1fe29b-0367-4011-9a9e-e92d84196d36 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:53.084961 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3d1fe29b-0367-4011-9a9e-e92d84196d36 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.157681 Aug 05 02:28:53.085517 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 493/988] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:52 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:28:54.107867 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-010a7eaa-6952-4f47-bede-79e8f4bf1902 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:54.108444 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-010a7eaa-6952-4f47-bede-79e8f4bf1902 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:54.115613 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-010a7eaa-6952-4f47-bede-79e8f4bf1902 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:54.116093 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-010a7eaa-6952-4f47-bede-79e8f4bf1902 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:54.116561 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-010a7eaa-6952-4f47-bede-79e8f4bf1902 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:54.117248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-010a7eaa-6952-4f47-bede-79e8f4bf1902 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:54.117700 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-010a7eaa-6952-4f47-bede-79e8f4bf1902 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:54.118121 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-010a7eaa-6952-4f47-bede-79e8f4bf1902 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:54.245027 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-010a7eaa-6952-4f47-bede-79e8f4bf1902 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:54.253426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-010a7eaa-6952-4f47-bede-79e8f4bf1902 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:54.254900 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-010a7eaa-6952-4f47-bede-79e8f4bf1902 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:54.256069 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-010a7eaa-6952-4f47-bede-79e8f4bf1902 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.152210 Aug 05 02:28:54.256655 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 496/989] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:54 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:28:54.905662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9f9d0641-9856-49aa-b0d5-1cf858bea409 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b99db175-05b8-437c-aaed-2643edfe826f", "device": "/dev/sdb"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:28:54.909045 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9f9d0641-9856-49aa-b0d5-1cf858bea409 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:54.911980 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:54.917517 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f9d0641-9856-49aa-b0d5-1cf858bea409 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:54.918022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f9d0641-9856-49aa-b0d5-1cf858bea409 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:54.918426 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f9d0641-9856-49aa-b0d5-1cf858bea409 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:54.919118 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f9d0641-9856-49aa-b0d5-1cf858bea409 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:54.919570 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f9d0641-9856-49aa-b0d5-1cf858bea409 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:54.919988 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9f9d0641-9856-49aa-b0d5-1cf858bea409 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:55.164427 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:55.183427 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9f9d0641-9856-49aa-b0d5-1cf858bea409 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "POST /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281514 Aug 05 02:28:55.184289 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 494/990] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Aug 5 02:28:54 2022] POST /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:28:55.279094 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5b699a11-c68e-438a-b6e1-b2a551377831 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:55.279702 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5b699a11-c68e-438a-b6e1-b2a551377831 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:55.283213 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:55.288264 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b699a11-c68e-438a-b6e1-b2a551377831 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:55.288795 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b699a11-c68e-438a-b6e1-b2a551377831 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:55.289221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b699a11-c68e-438a-b6e1-b2a551377831 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:55.289914 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b699a11-c68e-438a-b6e1-b2a551377831 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:55.290362 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b699a11-c68e-438a-b6e1-b2a551377831 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:55.290784 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5b699a11-c68e-438a-b6e1-b2a551377831 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:55.425396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5b699a11-c68e-438a-b6e1-b2a551377831 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:55.433333 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5b699a11-c68e-438a-b6e1-b2a551377831 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:55.434867 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5b699a11-c68e-438a-b6e1-b2a551377831 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:55.436047 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5b699a11-c68e-438a-b6e1-b2a551377831 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.160983 Aug 05 02:28:55.436630 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 497/991] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:55 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:28:56.459296 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a3bfaceb-731b-4670-bdf6-23b7fc10c54f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:56.459972 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a3bfaceb-731b-4670-bdf6-23b7fc10c54f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:56.466922 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3bfaceb-731b-4670-bdf6-23b7fc10c54f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:56.467337 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3bfaceb-731b-4670-bdf6-23b7fc10c54f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:56.467758 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3bfaceb-731b-4670-bdf6-23b7fc10c54f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:56.468464 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3bfaceb-731b-4670-bdf6-23b7fc10c54f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:56.468910 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3bfaceb-731b-4670-bdf6-23b7fc10c54f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:56.469980 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3bfaceb-731b-4670-bdf6-23b7fc10c54f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:56.486288 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:28:56.486777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Fri Aug 5 02:28:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:28:56.605809 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a3bfaceb-731b-4670-bdf6-23b7fc10c54f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:56.614641 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a3bfaceb-731b-4670-bdf6-23b7fc10c54f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:56.616631 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a3bfaceb-731b-4670-bdf6-23b7fc10c54f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:56.617876 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a3bfaceb-731b-4670-bdf6-23b7fc10c54f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.162854 Aug 05 02:28:56.618432 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 495/992] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:56 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:28:57.640936 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5068d701-3ba7-499b-b10a-a89dfbebf347 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:57.641664 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5068d701-3ba7-499b-b10a-a89dfbebf347 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:57.647828 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5068d701-3ba7-499b-b10a-a89dfbebf347 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:57.648302 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5068d701-3ba7-499b-b10a-a89dfbebf347 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:57.648766 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5068d701-3ba7-499b-b10a-a89dfbebf347 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:57.649445 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5068d701-3ba7-499b-b10a-a89dfbebf347 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:57.649890 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5068d701-3ba7-499b-b10a-a89dfbebf347 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:57.650305 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5068d701-3ba7-499b-b10a-a89dfbebf347 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:57.777155 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5068d701-3ba7-499b-b10a-a89dfbebf347 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:57.785186 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5068d701-3ba7-499b-b10a-a89dfbebf347 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:57.786671 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5068d701-3ba7-499b-b10a-a89dfbebf347 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:57.787814 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5068d701-3ba7-499b-b10a-a89dfbebf347 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.150887 Aug 05 02:28:57.788366 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 498/993] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:57 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:28:58.810782 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-db905855-a865-4054-b535-0b2f34ed6cbd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:58.811386 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-db905855-a865-4054-b535-0b2f34ed6cbd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:58.818470 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db905855-a865-4054-b535-0b2f34ed6cbd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:58.818947 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db905855-a865-4054-b535-0b2f34ed6cbd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:58.819379 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db905855-a865-4054-b535-0b2f34ed6cbd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:58.820058 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db905855-a865-4054-b535-0b2f34ed6cbd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:58.820546 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db905855-a865-4054-b535-0b2f34ed6cbd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:58.820967 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-db905855-a865-4054-b535-0b2f34ed6cbd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:58.957437 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-db905855-a865-4054-b535-0b2f34ed6cbd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:58.965661 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-db905855-a865-4054-b535-0b2f34ed6cbd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:58.967193 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-db905855-a865-4054-b535-0b2f34ed6cbd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:28:58.968345 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-db905855-a865-4054-b535-0b2f34ed6cbd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1744 microversion: 2.20 time: 0.161437 Aug 05 02:28:58.968915 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 496/994] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:58 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:28:59.991304 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3b5f9188-6069-450e-9e90-727c549e4c91 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:28:59.991913 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3b5f9188-6069-450e-9e90-727c549e4c91 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:28:59.998295 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b5f9188-6069-450e-9e90-727c549e4c91 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:28:59.998768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b5f9188-6069-450e-9e90-727c549e4c91 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:28:59.999198 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b5f9188-6069-450e-9e90-727c549e4c91 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:28:59.999874 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b5f9188-6069-450e-9e90-727c549e4c91 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:00.000387 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b5f9188-6069-450e-9e90-727c549e4c91 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:00.000946 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b5f9188-6069-450e-9e90-727c549e4c91 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:00.130744 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3b5f9188-6069-450e-9e90-727c549e4c91 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:00.138986 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3b5f9188-6069-450e-9e90-727c549e4c91 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:00.140555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3b5f9188-6069-450e-9e90-727c549e4c91 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:00.142980 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3b5f9188-6069-450e-9e90-727c549e4c91 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1744 microversion: 2.20 time: 0.154946 Aug 05 02:29:00.142980 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 499/995] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:28:59 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:01.165089 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-13fc02d1-3e77-47d5-9937-e7b97cb6ba23 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:01.165719 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-13fc02d1-3e77-47d5-9937-e7b97cb6ba23 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:01.171968 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13fc02d1-3e77-47d5-9937-e7b97cb6ba23 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:01.173037 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13fc02d1-3e77-47d5-9937-e7b97cb6ba23 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:01.174078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13fc02d1-3e77-47d5-9937-e7b97cb6ba23 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:01.174782 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13fc02d1-3e77-47d5-9937-e7b97cb6ba23 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:01.175230 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13fc02d1-3e77-47d5-9937-e7b97cb6ba23 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:01.176211 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-13fc02d1-3e77-47d5-9937-e7b97cb6ba23 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:01.306908 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-13fc02d1-3e77-47d5-9937-e7b97cb6ba23 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:01.315416 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-13fc02d1-3e77-47d5-9937-e7b97cb6ba23 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:01.316963 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-13fc02d1-3e77-47d5-9937-e7b97cb6ba23 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:01.318117 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-13fc02d1-3e77-47d5-9937-e7b97cb6ba23 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1744 microversion: 2.20 time: 0.156948 Aug 05 02:29:01.318671 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 497/996] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:01 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:02.341099 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c104cccf-b85d-4144-9009-e22e05457766 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:02.341713 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c104cccf-b85d-4144-9009-e22e05457766 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:02.348060 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c104cccf-b85d-4144-9009-e22e05457766 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:02.348574 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c104cccf-b85d-4144-9009-e22e05457766 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:02.349009 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c104cccf-b85d-4144-9009-e22e05457766 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:02.349751 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c104cccf-b85d-4144-9009-e22e05457766 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:02.350146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c104cccf-b85d-4144-9009-e22e05457766 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:02.350568 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c104cccf-b85d-4144-9009-e22e05457766 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:02.483287 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c104cccf-b85d-4144-9009-e22e05457766 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:02.491098 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c104cccf-b85d-4144-9009-e22e05457766 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:02.492706 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c104cccf-b85d-4144-9009-e22e05457766 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:02.493854 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c104cccf-b85d-4144-9009-e22e05457766 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1744 microversion: 2.20 time: 0.156708 Aug 05 02:29:02.494398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 500/997] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:02 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:02.947198 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-730d1cff-8006-435d-88f3-ca840ea788f0 req-ed6682ff-5cba-4253-acda-93994cc6818a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac84bba5-1a3a-4625-ad22-276df81d03a1", "name": "network-vif-plugged", "status": "completed", "tag": "a68b1751-4c77-41ca-80e7-300bcc5e2f50"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:29:02.959318 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-730d1cff-8006-435d-88f3-ca840ea788f0 req-ed6682ff-5cba-4253-acda-93994cc6818a service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:02.959799 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-730d1cff-8006-435d-88f3-ca840ea788f0 req-ed6682ff-5cba-4253-acda-93994cc6818a service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:02.960473 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-730d1cff-8006-435d-88f3-ca840ea788f0 req-ed6682ff-5cba-4253-acda-93994cc6818a service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:02.972274 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-730d1cff-8006-435d-88f3-ca840ea788f0 req-ed6682ff-5cba-4253-acda-93994cc6818a service nova] Creating event network-vif-plugged:a68b1751-4c77-41ca-80e7-300bcc5e2f50 for instance ac84bba5-1a3a-4625-ad22-276df81d03a1 on hv-cinder-81558 Aug 05 02:29:02.977323 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-730d1cff-8006-435d-88f3-ca840ea788f0 req-ed6682ff-5cba-4253-acda-93994cc6818a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034296 Aug 05 02:29:02.977901 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 498/998] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:29:03.517390 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a53b515e-9222-4417-b6b3-038d03c80611 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:03.517998 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a53b515e-9222-4417-b6b3-038d03c80611 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:03.524392 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a53b515e-9222-4417-b6b3-038d03c80611 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:03.524877 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a53b515e-9222-4417-b6b3-038d03c80611 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:03.525314 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a53b515e-9222-4417-b6b3-038d03c80611 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:03.526006 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a53b515e-9222-4417-b6b3-038d03c80611 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:03.526458 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a53b515e-9222-4417-b6b3-038d03c80611 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:03.526881 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a53b515e-9222-4417-b6b3-038d03c80611 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:03.656003 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a53b515e-9222-4417-b6b3-038d03c80611 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:03.663908 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a53b515e-9222-4417-b6b3-038d03c80611 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:03.665412 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a53b515e-9222-4417-b6b3-038d03c80611 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:03.666554 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a53b515e-9222-4417-b6b3-038d03c80611 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1744 microversion: 2.20 time: 0.153157 Aug 05 02:29:03.667092 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 501/999] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:03 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:04.691252 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-16e63053-3155-49df-a376-4a3bf313f862 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:04.691926 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-16e63053-3155-49df-a376-4a3bf313f862 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:04.699104 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16e63053-3155-49df-a376-4a3bf313f862 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:04.699583 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16e63053-3155-49df-a376-4a3bf313f862 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:04.700015 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16e63053-3155-49df-a376-4a3bf313f862 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:04.700728 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16e63053-3155-49df-a376-4a3bf313f862 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:04.702389 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16e63053-3155-49df-a376-4a3bf313f862 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:04.702389 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-16e63053-3155-49df-a376-4a3bf313f862 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:04.841795 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-16e63053-3155-49df-a376-4a3bf313f862 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:04.851332 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-16e63053-3155-49df-a376-4a3bf313f862 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:04.852900 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-16e63053-3155-49df-a376-4a3bf313f862 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:04.854061 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-16e63053-3155-49df-a376-4a3bf313f862 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1744 microversion: 2.20 time: 0.167279 Aug 05 02:29:04.854620 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 499/1000] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:04 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:05.878766 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ed2c0a43-9244-40f2-8dcd-a4b75cd3230a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:05.879370 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ed2c0a43-9244-40f2-8dcd-a4b75cd3230a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:05.885823 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed2c0a43-9244-40f2-8dcd-a4b75cd3230a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:05.886304 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed2c0a43-9244-40f2-8dcd-a4b75cd3230a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:05.886741 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed2c0a43-9244-40f2-8dcd-a4b75cd3230a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:05.887424 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed2c0a43-9244-40f2-8dcd-a4b75cd3230a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:05.887872 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed2c0a43-9244-40f2-8dcd-a4b75cd3230a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:05.888294 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed2c0a43-9244-40f2-8dcd-a4b75cd3230a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:06.022042 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ed2c0a43-9244-40f2-8dcd-a4b75cd3230a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:06.029865 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ed2c0a43-9244-40f2-8dcd-a4b75cd3230a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:06.031357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ed2c0a43-9244-40f2-8dcd-a4b75cd3230a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:06.032631 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ed2c0a43-9244-40f2-8dcd-a4b75cd3230a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1744 microversion: 2.20 time: 0.157676 Aug 05 02:29:06.033301 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 502/1001] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:05 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:07.056238 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e6b94413-f037-4e7f-a19c-745e9c25f16b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:07.056808 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e6b94413-f037-4e7f-a19c-745e9c25f16b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:07.063184 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e6b94413-f037-4e7f-a19c-745e9c25f16b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:07.064282 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e6b94413-f037-4e7f-a19c-745e9c25f16b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:07.064605 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e6b94413-f037-4e7f-a19c-745e9c25f16b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:07.065287 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e6b94413-f037-4e7f-a19c-745e9c25f16b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:07.065733 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e6b94413-f037-4e7f-a19c-745e9c25f16b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:07.066150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e6b94413-f037-4e7f-a19c-745e9c25f16b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:07.197448 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e6b94413-f037-4e7f-a19c-745e9c25f16b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:07.205606 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e6b94413-f037-4e7f-a19c-745e9c25f16b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:07.207115 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e6b94413-f037-4e7f-a19c-745e9c25f16b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:07.208275 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e6b94413-f037-4e7f-a19c-745e9c25f16b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1744 microversion: 2.20 time: 0.156022 Aug 05 02:29:07.208857 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 500/1002] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:07 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:08.230949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-41f5fc7f-ad63-433d-a5c0-a24741d81017 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:08.231554 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-41f5fc7f-ad63-433d-a5c0-a24741d81017 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:08.238387 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41f5fc7f-ad63-433d-a5c0-a24741d81017 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:08.238863 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41f5fc7f-ad63-433d-a5c0-a24741d81017 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:08.239295 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41f5fc7f-ad63-433d-a5c0-a24741d81017 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:08.239980 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41f5fc7f-ad63-433d-a5c0-a24741d81017 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:08.240452 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41f5fc7f-ad63-433d-a5c0-a24741d81017 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:08.240872 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41f5fc7f-ad63-433d-a5c0-a24741d81017 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:08.369507 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-41f5fc7f-ad63-433d-a5c0-a24741d81017 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:08.378066 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-41f5fc7f-ad63-433d-a5c0-a24741d81017 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:08.379569 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-41f5fc7f-ad63-433d-a5c0-a24741d81017 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:08.380779 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-41f5fc7f-ad63-433d-a5c0-a24741d81017 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1744 microversion: 2.20 time: 0.153633 Aug 05 02:29:08.381340 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 503/1003] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:08 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:09.404360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cfc361f1-ef89-40e1-95df-63c1c736ac94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:09.404898 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-cfc361f1-ef89-40e1-95df-63c1c736ac94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:09.411122 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cfc361f1-ef89-40e1-95df-63c1c736ac94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:09.411595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cfc361f1-ef89-40e1-95df-63c1c736ac94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:09.412022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cfc361f1-ef89-40e1-95df-63c1c736ac94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:09.412740 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cfc361f1-ef89-40e1-95df-63c1c736ac94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:09.413185 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cfc361f1-ef89-40e1-95df-63c1c736ac94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:09.413601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-cfc361f1-ef89-40e1-95df-63c1c736ac94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:09.539539 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cfc361f1-ef89-40e1-95df-63c1c736ac94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:09.547292 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cfc361f1-ef89-40e1-95df-63c1c736ac94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:09.548820 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-cfc361f1-ef89-40e1-95df-63c1c736ac94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:09.550690 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cfc361f1-ef89-40e1-95df-63c1c736ac94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1744 microversion: 2.20 time: 0.150264 Aug 05 02:29:09.551247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 501/1004] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:09 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:10.573865 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0e5f7d4a-0a04-4d9b-8b77-af4b5faa4dc2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:10.574414 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0e5f7d4a-0a04-4d9b-8b77-af4b5faa4dc2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:10.581900 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e5f7d4a-0a04-4d9b-8b77-af4b5faa4dc2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:10.582376 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e5f7d4a-0a04-4d9b-8b77-af4b5faa4dc2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:10.582807 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e5f7d4a-0a04-4d9b-8b77-af4b5faa4dc2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:10.583491 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e5f7d4a-0a04-4d9b-8b77-af4b5faa4dc2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:10.583937 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e5f7d4a-0a04-4d9b-8b77-af4b5faa4dc2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:10.584387 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0e5f7d4a-0a04-4d9b-8b77-af4b5faa4dc2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:10.712941 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0e5f7d4a-0a04-4d9b-8b77-af4b5faa4dc2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:10.720759 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0e5f7d4a-0a04-4d9b-8b77-af4b5faa4dc2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:10.722869 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0e5f7d4a-0a04-4d9b-8b77-af4b5faa4dc2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:10.724029 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0e5f7d4a-0a04-4d9b-8b77-af4b5faa4dc2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1744 microversion: 2.20 time: 0.154189 Aug 05 02:29:10.724618 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 504/1005] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:10 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:10.732546 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-32a74e59-09ce-420e-a1b9-1d2ef58da541 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:10.733057 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-32a74e59-09ce-420e-a1b9-1d2ef58da541 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:10.739290 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32a74e59-09ce-420e-a1b9-1d2ef58da541 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:10.739764 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32a74e59-09ce-420e-a1b9-1d2ef58da541 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:10.740193 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32a74e59-09ce-420e-a1b9-1d2ef58da541 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:10.740894 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32a74e59-09ce-420e-a1b9-1d2ef58da541 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:10.741362 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32a74e59-09ce-420e-a1b9-1d2ef58da541 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:10.741779 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-32a74e59-09ce-420e-a1b9-1d2ef58da541 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:10.764952 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-32a74e59-09ce-420e-a1b9-1d2ef58da541 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/ips" status: 200 len: 147 microversion: 2.1 time: 0.036210 Aug 05 02:29:10.765514 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 502/1006] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Aug 5 02:29:10 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:29:11.747189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-59f084c5-28e4-4099-98da-121f71c09f7e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:11.747776 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-59f084c5-28e4-4099-98da-121f71c09f7e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:11.755273 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59f084c5-28e4-4099-98da-121f71c09f7e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:11.755753 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59f084c5-28e4-4099-98da-121f71c09f7e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:11.756191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59f084c5-28e4-4099-98da-121f71c09f7e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:11.756910 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59f084c5-28e4-4099-98da-121f71c09f7e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:11.757364 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59f084c5-28e4-4099-98da-121f71c09f7e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:11.757788 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59f084c5-28e4-4099-98da-121f71c09f7e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:11.887877 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-59f084c5-28e4-4099-98da-121f71c09f7e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:11.896743 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-59f084c5-28e4-4099-98da-121f71c09f7e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:11.898240 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-59f084c5-28e4-4099-98da-121f71c09f7e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:11.899393 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-59f084c5-28e4-4099-98da-121f71c09f7e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1744 microversion: 2.20 time: 0.156124 Aug 05 02:29:11.899949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 505/1007] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:11 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:12.922886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7c896123-7656-40e6-857f-da2fec7a59fc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:12.923496 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7c896123-7656-40e6-857f-da2fec7a59fc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:12.930551 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7c896123-7656-40e6-857f-da2fec7a59fc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:12.931030 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7c896123-7656-40e6-857f-da2fec7a59fc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:12.931466 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7c896123-7656-40e6-857f-da2fec7a59fc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:12.932151 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7c896123-7656-40e6-857f-da2fec7a59fc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:12.932638 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7c896123-7656-40e6-857f-da2fec7a59fc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:12.933063 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7c896123-7656-40e6-857f-da2fec7a59fc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:13.062495 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7c896123-7656-40e6-857f-da2fec7a59fc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:13.070747 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7c896123-7656-40e6-857f-da2fec7a59fc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:13.072245 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7c896123-7656-40e6-857f-da2fec7a59fc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:13.073430 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7c896123-7656-40e6-857f-da2fec7a59fc tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1744 microversion: 2.20 time: 0.154470 Aug 05 02:29:13.073990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 503/1008] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:12 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:14.097595 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a0c747cb-c676-480c-b95b-10a714bc759f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:14.098125 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a0c747cb-c676-480c-b95b-10a714bc759f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:14.104624 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0c747cb-c676-480c-b95b-10a714bc759f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:14.105102 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0c747cb-c676-480c-b95b-10a714bc759f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:14.105539 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0c747cb-c676-480c-b95b-10a714bc759f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:14.106225 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0c747cb-c676-480c-b95b-10a714bc759f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:14.106669 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0c747cb-c676-480c-b95b-10a714bc759f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:14.107087 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0c747cb-c676-480c-b95b-10a714bc759f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:14.237651 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a0c747cb-c676-480c-b95b-10a714bc759f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:14.245436 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a0c747cb-c676-480c-b95b-10a714bc759f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:14.246936 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a0c747cb-c676-480c-b95b-10a714bc759f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:14.248085 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a0c747cb-c676-480c-b95b-10a714bc759f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1744 microversion: 2.20 time: 0.155192 Aug 05 02:29:14.248663 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 506/1009] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:14 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:15.271283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3be84eb8-b021-47ce-980b-1e6a9cc3678b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:15.271946 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3be84eb8-b021-47ce-980b-1e6a9cc3678b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:15.278611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3be84eb8-b021-47ce-980b-1e6a9cc3678b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:15.279060 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3be84eb8-b021-47ce-980b-1e6a9cc3678b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:15.279491 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3be84eb8-b021-47ce-980b-1e6a9cc3678b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:15.280177 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3be84eb8-b021-47ce-980b-1e6a9cc3678b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:15.280688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3be84eb8-b021-47ce-980b-1e6a9cc3678b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:15.281113 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3be84eb8-b021-47ce-980b-1e6a9cc3678b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:15.412410 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3be84eb8-b021-47ce-980b-1e6a9cc3678b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:15.420716 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3be84eb8-b021-47ce-980b-1e6a9cc3678b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:15.423047 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3be84eb8-b021-47ce-980b-1e6a9cc3678b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:15.424984 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3be84eb8-b021-47ce-980b-1e6a9cc3678b tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1739 microversion: 2.20 time: 0.157804 Aug 05 02:29:15.426053 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 504/1010] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:15 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:16.316007 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-936494b7-bd1c-4996-a344-d3ffa1a855e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cf97f20-c016-4e04-9190-f511abc6ac7b"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:29:16.318414 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-936494b7-bd1c-4996-a344-d3ffa1a855e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:16.326612 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-936494b7-bd1c-4996-a344-d3ffa1a855e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:16.327157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-936494b7-bd1c-4996-a344-d3ffa1a855e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:16.328008 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-936494b7-bd1c-4996-a344-d3ffa1a855e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:16.328755 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-936494b7-bd1c-4996-a344-d3ffa1a855e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:16.329210 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-936494b7-bd1c-4996-a344-d3ffa1a855e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:16.329639 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-936494b7-bd1c-4996-a344-d3ffa1a855e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:16.450452 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f930787b-a253-45a9-87fe-7207e163bd44 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:16.451045 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f930787b-a253-45a9-87fe-7207e163bd44 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:16.457985 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f930787b-a253-45a9-87fe-7207e163bd44 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:16.458706 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f930787b-a253-45a9-87fe-7207e163bd44 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:16.459301 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f930787b-a253-45a9-87fe-7207e163bd44 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:16.460186 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f930787b-a253-45a9-87fe-7207e163bd44 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:16.460812 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f930787b-a253-45a9-87fe-7207e163bd44 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:16.461734 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f930787b-a253-45a9-87fe-7207e163bd44 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:16.616944 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f930787b-a253-45a9-87fe-7207e163bd44 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:16.629563 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f930787b-a253-45a9-87fe-7207e163bd44 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:16.633074 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f930787b-a253-45a9-87fe-7207e163bd44 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:16.634282 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f930787b-a253-45a9-87fe-7207e163bd44 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1739 microversion: 2.20 time: 0.188779 Aug 05 02:29:16.634839 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 505/1011] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:16 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:17.658266 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-598f6cae-e09c-452a-9782-de0afc849bec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:17.659226 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-598f6cae-e09c-452a-9782-de0afc849bec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:17.670002 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-598f6cae-e09c-452a-9782-de0afc849bec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:17.670499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-598f6cae-e09c-452a-9782-de0afc849bec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:17.671125 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-598f6cae-e09c-452a-9782-de0afc849bec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:17.672180 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-598f6cae-e09c-452a-9782-de0afc849bec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:17.672915 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-598f6cae-e09c-452a-9782-de0afc849bec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:17.673557 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-598f6cae-e09c-452a-9782-de0afc849bec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:17.830848 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-598f6cae-e09c-452a-9782-de0afc849bec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:17.836898 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-598f6cae-e09c-452a-9782-de0afc849bec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:17.838552 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-598f6cae-e09c-452a-9782-de0afc849bec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:17.839774 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-598f6cae-e09c-452a-9782-de0afc849bec tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1739 microversion: 2.20 time: 0.185569 Aug 05 02:29:17.840595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 506/1012] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:17 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:29:18.866012 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-09c4e7ea-c74d-4d2f-9ad1-9fd3f3e3e138 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:18.866700 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-09c4e7ea-c74d-4d2f-9ad1-9fd3f3e3e138 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:18.874309 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09c4e7ea-c74d-4d2f-9ad1-9fd3f3e3e138 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:18.874797 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09c4e7ea-c74d-4d2f-9ad1-9fd3f3e3e138 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:18.875470 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09c4e7ea-c74d-4d2f-9ad1-9fd3f3e3e138 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:18.876497 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09c4e7ea-c74d-4d2f-9ad1-9fd3f3e3e138 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:18.877018 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09c4e7ea-c74d-4d2f-9ad1-9fd3f3e3e138 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:18.877886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-09c4e7ea-c74d-4d2f-9ad1-9fd3f3e3e138 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:19.022849 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-09c4e7ea-c74d-4d2f-9ad1-9fd3f3e3e138 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:19.031058 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-09c4e7ea-c74d-4d2f-9ad1-9fd3f3e3e138 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:19.032747 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-09c4e7ea-c74d-4d2f-9ad1-9fd3f3e3e138 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:19.034643 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-09c4e7ea-c74d-4d2f-9ad1-9fd3f3e3e138 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1739 microversion: 2.20 time: 0.173054 Aug 05 02:29:19.035206 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 507/1013] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:18 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:29:19.991900 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:20.069856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0fd5b8c6-4039-4d62-be84-958c6e16a373 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:20.070476 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0fd5b8c6-4039-4d62-be84-958c6e16a373 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:20.084875 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fd5b8c6-4039-4d62-be84-958c6e16a373 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:20.085691 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fd5b8c6-4039-4d62-be84-958c6e16a373 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:20.086353 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fd5b8c6-4039-4d62-be84-958c6e16a373 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:20.087522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fd5b8c6-4039-4d62-be84-958c6e16a373 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:20.088183 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fd5b8c6-4039-4d62-be84-958c6e16a373 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:20.088709 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fd5b8c6-4039-4d62-be84-958c6e16a373 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:20.132415 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-936494b7-bd1c-4996-a344-d3ffa1a855e3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "POST /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.820696 Aug 05 02:29:20.133022 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 507/1014] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Aug 5 02:29:16 2022] POST /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments => generated 194 bytes in 3822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:29:20.248266 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0fd5b8c6-4039-4d62-be84-958c6e16a373 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:20.256756 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0fd5b8c6-4039-4d62-be84-958c6e16a373 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:20.258259 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0fd5b8c6-4039-4d62-be84-958c6e16a373 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:20.259503 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0fd5b8c6-4039-4d62-be84-958c6e16a373 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1739 microversion: 2.20 time: 0.203501 Aug 05 02:29:20.261033 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 508/1015] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:20 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:29:21.287131 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eb038a32-5a20-41fc-a293-02b4d5896734 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:21.288842 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eb038a32-5a20-41fc-a293-02b4d5896734 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:21.299754 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb038a32-5a20-41fc-a293-02b4d5896734 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:21.300396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb038a32-5a20-41fc-a293-02b4d5896734 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:21.300854 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb038a32-5a20-41fc-a293-02b4d5896734 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:21.301955 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb038a32-5a20-41fc-a293-02b4d5896734 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:21.302267 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb038a32-5a20-41fc-a293-02b4d5896734 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:21.302718 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb038a32-5a20-41fc-a293-02b4d5896734 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:21.459643 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eb038a32-5a20-41fc-a293-02b4d5896734 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:21.468808 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eb038a32-5a20-41fc-a293-02b4d5896734 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:21.470665 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eb038a32-5a20-41fc-a293-02b4d5896734 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:21.472057 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eb038a32-5a20-41fc-a293-02b4d5896734 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1739 microversion: 2.20 time: 0.191789 Aug 05 02:29:21.473542 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 508/1016] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:21 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:22.497310 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-57c25740-6c91-4e8b-9807-afa2a1fb178f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:22.498046 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-57c25740-6c91-4e8b-9807-afa2a1fb178f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:22.506152 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57c25740-6c91-4e8b-9807-afa2a1fb178f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:22.506745 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57c25740-6c91-4e8b-9807-afa2a1fb178f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:22.507074 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57c25740-6c91-4e8b-9807-afa2a1fb178f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:22.507963 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57c25740-6c91-4e8b-9807-afa2a1fb178f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:22.508764 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57c25740-6c91-4e8b-9807-afa2a1fb178f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:22.509474 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57c25740-6c91-4e8b-9807-afa2a1fb178f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:22.663600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-57c25740-6c91-4e8b-9807-afa2a1fb178f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:22.672311 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-57c25740-6c91-4e8b-9807-afa2a1fb178f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:22.674472 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-57c25740-6c91-4e8b-9807-afa2a1fb178f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:22.676045 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-57c25740-6c91-4e8b-9807-afa2a1fb178f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1739 microversion: 2.20 time: 0.182774 Aug 05 02:29:22.676772 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 509/1017] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:22 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:23.700203 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1d296a65-6443-4a7a-9cc5-fd88673600a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:23.700843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1d296a65-6443-4a7a-9cc5-fd88673600a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:23.708197 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d296a65-6443-4a7a-9cc5-fd88673600a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:23.708911 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d296a65-6443-4a7a-9cc5-fd88673600a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:23.709351 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d296a65-6443-4a7a-9cc5-fd88673600a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:23.710055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d296a65-6443-4a7a-9cc5-fd88673600a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:23.710506 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d296a65-6443-4a7a-9cc5-fd88673600a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:23.710929 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1d296a65-6443-4a7a-9cc5-fd88673600a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:23.851989 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1d296a65-6443-4a7a-9cc5-fd88673600a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:23.860583 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1d296a65-6443-4a7a-9cc5-fd88673600a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:23.862895 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1d296a65-6443-4a7a-9cc5-fd88673600a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:23.864680 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1d296a65-6443-4a7a-9cc5-fd88673600a2 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1739 microversion: 2.20 time: 0.168353 Aug 05 02:29:23.865232 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 509/1018] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:23 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:24.889332 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7e095b39-2e6d-4088-a3c3-b56883de15c3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:24.889948 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7e095b39-2e6d-4088-a3c3-b56883de15c3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:24.898435 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e095b39-2e6d-4088-a3c3-b56883de15c3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:24.899017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e095b39-2e6d-4088-a3c3-b56883de15c3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:24.899531 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e095b39-2e6d-4088-a3c3-b56883de15c3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:24.900313 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e095b39-2e6d-4088-a3c3-b56883de15c3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:24.900883 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e095b39-2e6d-4088-a3c3-b56883de15c3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:24.901563 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7e095b39-2e6d-4088-a3c3-b56883de15c3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:25.045037 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7e095b39-2e6d-4088-a3c3-b56883de15c3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:25.053311 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7e095b39-2e6d-4088-a3c3-b56883de15c3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:25.054796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7e095b39-2e6d-4088-a3c3-b56883de15c3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:25.055952 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7e095b39-2e6d-4088-a3c3-b56883de15c3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1739 microversion: 2.20 time: 0.170634 Aug 05 02:29:25.056527 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 510/1019] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:24 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:25.145320 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-40ba1ae0-a853-409d-8a66-d24e90914325 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:25.145931 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-40ba1ae0-a853-409d-8a66-d24e90914325 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:25.152288 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-40ba1ae0-a853-409d-8a66-d24e90914325 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:25.152799 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-40ba1ae0-a853-409d-8a66-d24e90914325 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:25.153225 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-40ba1ae0-a853-409d-8a66-d24e90914325 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:25.153906 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-40ba1ae0-a853-409d-8a66-d24e90914325 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:25.154582 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-40ba1ae0-a853-409d-8a66-d24e90914325 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:25.155087 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-40ba1ae0-a853-409d-8a66-d24e90914325 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:25.243725 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-40ba1ae0-a853-409d-8a66-d24e90914325 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lazy-loading 'services' on Instance uuid bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:29:25.315869 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-40ba1ae0-a853-409d-8a66-d24e90914325 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1/os-volume_attachments/b99db175-05b8-437c-aaed-2643edfe826f" status: 202 len: 0 microversion: 2.1 time: 0.174920 Aug 05 02:29:25.316487 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 510/1020] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Aug 5 02:29:25 2022] DELETE /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1/os-volume_attachments/b99db175-05b8-437c-aaed-2643edfe826f => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:29:26.085339 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-86a7b0dd-a644-4f14-bab8-e58e2c385739 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:26.085953 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-86a7b0dd-a644-4f14-bab8-e58e2c385739 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:26.090446 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=34 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:26.095045 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86a7b0dd-a644-4f14-bab8-e58e2c385739 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:26.095527 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86a7b0dd-a644-4f14-bab8-e58e2c385739 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:26.096545 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86a7b0dd-a644-4f14-bab8-e58e2c385739 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:26.097396 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86a7b0dd-a644-4f14-bab8-e58e2c385739 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:26.098339 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86a7b0dd-a644-4f14-bab8-e58e2c385739 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:26.098772 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-86a7b0dd-a644-4f14-bab8-e58e2c385739 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:26.101639 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:26.232451 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-86a7b0dd-a644-4f14-bab8-e58e2c385739 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:26.240491 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-86a7b0dd-a644-4f14-bab8-e58e2c385739 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:26.241974 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-86a7b0dd-a644-4f14-bab8-e58e2c385739 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:26.243114 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-86a7b0dd-a644-4f14-bab8-e58e2c385739 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1721 microversion: 2.20 time: 0.161911 Aug 05 02:29:26.243656 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 511/1021] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:26 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:27.267750 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-34533fff-8bdc-442b-91f6-72096f06b46f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:27.268680 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-34533fff-8bdc-442b-91f6-72096f06b46f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:27.270685 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=28 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:27.276149 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34533fff-8bdc-442b-91f6-72096f06b46f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:27.276681 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34533fff-8bdc-442b-91f6-72096f06b46f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:27.277116 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34533fff-8bdc-442b-91f6-72096f06b46f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:27.277799 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34533fff-8bdc-442b-91f6-72096f06b46f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:27.278256 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34533fff-8bdc-442b-91f6-72096f06b46f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:27.278675 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34533fff-8bdc-442b-91f6-72096f06b46f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:27.682779 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-34533fff-8bdc-442b-91f6-72096f06b46f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:27.691189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-34533fff-8bdc-442b-91f6-72096f06b46f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:27.692703 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-34533fff-8bdc-442b-91f6-72096f06b46f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:27.694237 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-34533fff-8bdc-442b-91f6-72096f06b46f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1721 microversion: 2.20 time: 0.431118 Aug 05 02:29:27.694425 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 511/1022] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:27 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1721 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:28.717003 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e934f6c2-e3c1-4b87-a572-a5b47fff5adb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:28.717606 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e934f6c2-e3c1-4b87-a572-a5b47fff5adb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:28.724163 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e934f6c2-e3c1-4b87-a572-a5b47fff5adb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:28.724688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e934f6c2-e3c1-4b87-a572-a5b47fff5adb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:28.725120 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e934f6c2-e3c1-4b87-a572-a5b47fff5adb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:28.725806 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e934f6c2-e3c1-4b87-a572-a5b47fff5adb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:28.726257 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e934f6c2-e3c1-4b87-a572-a5b47fff5adb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:28.726677 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e934f6c2-e3c1-4b87-a572-a5b47fff5adb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:28.796021 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-705303d0-ad28-4c95-9ec1-7858220f02ee tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:28.798361 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-705303d0-ad28-4c95-9ec1-7858220f02ee tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:28.805285 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-705303d0-ad28-4c95-9ec1-7858220f02ee tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:28.805424 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-705303d0-ad28-4c95-9ec1-7858220f02ee tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:28.805861 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-705303d0-ad28-4c95-9ec1-7858220f02ee tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:28.806563 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-705303d0-ad28-4c95-9ec1-7858220f02ee tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:28.807026 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-705303d0-ad28-4c95-9ec1-7858220f02ee tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:28.807453 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-705303d0-ad28-4c95-9ec1-7858220f02ee tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:28.839746 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-705303d0-ad28-4c95-9ec1-7858220f02ee tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047586 Aug 05 02:29:28.840554 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 512/1023] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:29:28 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:29:28.851119 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b82d6e14-e56c-4d58-9ce1-39846a423349 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:28.851600 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b82d6e14-e56c-4d58-9ce1-39846a423349 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:28.857777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b82d6e14-e56c-4d58-9ce1-39846a423349 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:28.858098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e934f6c2-e3c1-4b87-a572-a5b47fff5adb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:28.858258 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b82d6e14-e56c-4d58-9ce1-39846a423349 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:28.858693 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b82d6e14-e56c-4d58-9ce1-39846a423349 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:28.859389 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b82d6e14-e56c-4d58-9ce1-39846a423349 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:28.859857 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b82d6e14-e56c-4d58-9ce1-39846a423349 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:28.860590 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b82d6e14-e56c-4d58-9ce1-39846a423349 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:28.866608 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e934f6c2-e3c1-4b87-a572-a5b47fff5adb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:28.868104 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e934f6c2-e3c1-4b87-a572-a5b47fff5adb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:28.869310 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e934f6c2-e3c1-4b87-a572-a5b47fff5adb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1721 microversion: 2.20 time: 0.156134 Aug 05 02:29:28.870236 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 512/1024] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:28 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:28.889614 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b82d6e14-e56c-4d58-9ce1-39846a423349 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments/7cf97f20-c016-4e04-9190-f511abc6ac7b" status: 200 len: 194 microversion: 2.1 time: 0.042336 Aug 05 02:29:28.890173 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 513/1025] 10.222.0.15 () {58 vars in 1413 bytes} [Fri Aug 5 02:29:28 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments/7cf97f20-c016-4e04-9190-f511abc6ac7b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:29:29.004053 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-15729935-bf4e-45d5-9696-001aaa8490bd req-6cd9e8db-c8fd-4b4b-aad0-efd004f2714f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac84bba5-1a3a-4625-ad22-276df81d03a1", "name": "network-vif-unplugged", "status": "completed", "tag": "a68b1751-4c77-41ca-80e7-300bcc5e2f50"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:29:29.016894 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-15729935-bf4e-45d5-9696-001aaa8490bd req-6cd9e8db-c8fd-4b4b-aad0-efd004f2714f service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:29.017363 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-15729935-bf4e-45d5-9696-001aaa8490bd req-6cd9e8db-c8fd-4b4b-aad0-efd004f2714f service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:29.017882 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-15729935-bf4e-45d5-9696-001aaa8490bd req-6cd9e8db-c8fd-4b4b-aad0-efd004f2714f service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:29.031823 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-15729935-bf4e-45d5-9696-001aaa8490bd req-6cd9e8db-c8fd-4b4b-aad0-efd004f2714f service nova] Creating event network-vif-unplugged:a68b1751-4c77-41ca-80e7-300bcc5e2f50 for instance ac84bba5-1a3a-4625-ad22-276df81d03a1 on hv-cinder-81558 Aug 05 02:29:29.037058 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-15729935-bf4e-45d5-9696-001aaa8490bd req-6cd9e8db-c8fd-4b4b-aad0-efd004f2714f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037815 Aug 05 02:29:29.038057 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 513/1026] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:29:29.892194 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-915aa173-1c01-4f78-9100-df3bc198aa94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:29.893799 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-915aa173-1c01-4f78-9100-df3bc198aa94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:29.900145 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-915aa173-1c01-4f78-9100-df3bc198aa94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:29.900680 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-915aa173-1c01-4f78-9100-df3bc198aa94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:29.901116 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-915aa173-1c01-4f78-9100-df3bc198aa94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:29.901807 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-915aa173-1c01-4f78-9100-df3bc198aa94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:29.902260 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-915aa173-1c01-4f78-9100-df3bc198aa94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:29.902679 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-915aa173-1c01-4f78-9100-df3bc198aa94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:30.035098 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-915aa173-1c01-4f78-9100-df3bc198aa94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:30.043010 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-915aa173-1c01-4f78-9100-df3bc198aa94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:30.044541 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-915aa173-1c01-4f78-9100-df3bc198aa94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:30.045692 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-915aa173-1c01-4f78-9100-df3bc198aa94 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1721 microversion: 2.20 time: 0.157404 Aug 05 02:29:30.046239 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 514/1027] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:29 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:30.242459 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5ba533c9-2629-4447-89bc-8afc5f4e3bad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2678253e-5ccc-48e4-b23d-4dbebb4779c5"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:29:30.244848 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5ba533c9-2629-4447-89bc-8afc5f4e3bad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:30.250825 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ba533c9-2629-4447-89bc-8afc5f4e3bad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:30.251297 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ba533c9-2629-4447-89bc-8afc5f4e3bad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:30.251732 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ba533c9-2629-4447-89bc-8afc5f4e3bad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:30.252703 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ba533c9-2629-4447-89bc-8afc5f4e3bad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:30.253159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ba533c9-2629-4447-89bc-8afc5f4e3bad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:30.253600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5ba533c9-2629-4447-89bc-8afc5f4e3bad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:30.685397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0b5fe57c-5833-44de-9df5-ab747ba0d452 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:30.685892 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0b5fe57c-5833-44de-9df5-ab747ba0d452 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:30.693018 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0b5fe57c-5833-44de-9df5-ab747ba0d452 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:30.693559 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0b5fe57c-5833-44de-9df5-ab747ba0d452 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:30.693937 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0b5fe57c-5833-44de-9df5-ab747ba0d452 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:30.694633 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0b5fe57c-5833-44de-9df5-ab747ba0d452 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:30.695105 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0b5fe57c-5833-44de-9df5-ab747ba0d452 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:30.695515 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0b5fe57c-5833-44de-9df5-ab747ba0d452 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:30.723180 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0b5fe57c-5833-44de-9df5-ab747ba0d452 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:29:30.806205 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5ba533c9-2629-4447-89bc-8afc5f4e3bad tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "POST /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.568435 Aug 05 02:29:30.806450 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0b5fe57c-5833-44de-9df5-ab747ba0d452 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 204 len: 0 microversion: 2.1 time: 0.124718 Aug 05 02:29:30.807237 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 515/1029] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:29:30 2022] DELETE /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:30.807365 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 514/1029] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Aug 5 02:29:30 2022] POST /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments => generated 194 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:29:30.817981 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f8a878e6-6287-4380-b573-a93ee5b0632a tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:30.818677 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f8a878e6-6287-4380-b573-a93ee5b0632a tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:30.824747 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8a878e6-6287-4380-b573-a93ee5b0632a tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:30.825230 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8a878e6-6287-4380-b573-a93ee5b0632a tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:30.825666 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8a878e6-6287-4380-b573-a93ee5b0632a tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:30.826360 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8a878e6-6287-4380-b573-a93ee5b0632a tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:30.826815 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8a878e6-6287-4380-b573-a93ee5b0632a tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:30.827275 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8a878e6-6287-4380-b573-a93ee5b0632a tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:30.965111 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8a878e6-6287-4380-b573-a93ee5b0632a tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:30.973148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f8a878e6-6287-4380-b573-a93ee5b0632a tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 200 len: 1513 microversion: 2.1 time: 0.161638 Aug 05 02:29:30.973715 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 516/1030] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:29:30 2022] GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:31.069307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4cfcbfeb-4f23-49dd-a773-e3da9c387453 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:31.070036 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4cfcbfeb-4f23-49dd-a773-e3da9c387453 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:31.076906 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cfcbfeb-4f23-49dd-a773-e3da9c387453 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:31.077379 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cfcbfeb-4f23-49dd-a773-e3da9c387453 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:31.077808 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cfcbfeb-4f23-49dd-a773-e3da9c387453 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:31.078489 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cfcbfeb-4f23-49dd-a773-e3da9c387453 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:31.078942 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cfcbfeb-4f23-49dd-a773-e3da9c387453 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:31.079360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4cfcbfeb-4f23-49dd-a773-e3da9c387453 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:31.213051 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4cfcbfeb-4f23-49dd-a773-e3da9c387453 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:31.221469 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4cfcbfeb-4f23-49dd-a773-e3da9c387453 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:31.222954 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4cfcbfeb-4f23-49dd-a773-e3da9c387453 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:31.224095 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4cfcbfeb-4f23-49dd-a773-e3da9c387453 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1664 microversion: 2.20 time: 0.159176 Aug 05 02:29:31.224696 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 515/1031] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:31 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:31.246639 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-87650e0d-ff5d-49af-a255-ceee0c9b2038 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e5de211-d7ca-4fd5-b0cf-7fd506440738"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:29:31.249086 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-87650e0d-ff5d-49af-a255-ceee0c9b2038 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:31.255085 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87650e0d-ff5d-49af-a255-ceee0c9b2038 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:31.255559 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87650e0d-ff5d-49af-a255-ceee0c9b2038 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:31.255986 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87650e0d-ff5d-49af-a255-ceee0c9b2038 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:31.256701 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87650e0d-ff5d-49af-a255-ceee0c9b2038 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:31.257150 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87650e0d-ff5d-49af-a255-ceee0c9b2038 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:31.257567 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87650e0d-ff5d-49af-a255-ceee0c9b2038 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:31.518921 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-87650e0d-ff5d-49af-a255-ceee0c9b2038 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "POST /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.276222 Aug 05 02:29:31.519525 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 517/1032] 10.222.0.15 () {62 vars in 1364 bytes} [Fri Aug 5 02:29:31 2022] POST /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1/os-volume_attachments => generated 188 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 05 02:29:31.642222 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a7d688ac-ad2b-4b4d-9bdb-d4cc5b1d7e54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:31.643388 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a7d688ac-ad2b-4b4d-9bdb-d4cc5b1d7e54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:31.649710 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7d688ac-ad2b-4b4d-9bdb-d4cc5b1d7e54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:31.650186 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7d688ac-ad2b-4b4d-9bdb-d4cc5b1d7e54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:31.650621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7d688ac-ad2b-4b4d-9bdb-d4cc5b1d7e54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:31.651307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7d688ac-ad2b-4b4d-9bdb-d4cc5b1d7e54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:31.651758 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7d688ac-ad2b-4b4d-9bdb-d4cc5b1d7e54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:31.652180 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7d688ac-ad2b-4b4d-9bdb-d4cc5b1d7e54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:31.903332 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a7d688ac-ad2b-4b4d-9bdb-d4cc5b1d7e54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1/os-volume_attachments/4e5de211-d7ca-4fd5-b0cf-7fd506440738" status: 202 len: 0 microversion: 2.20 time: 0.264935 Aug 05 02:29:31.907165 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 516/1033] 10.222.0.15 () {60 vars in 1457 bytes} [Fri Aug 5 02:29:31 2022] DELETE /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1/os-volume_attachments/4e5de211-d7ca-4fd5-b0cf-7fd506440738 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:31.963250 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ad51fbd3-6100-40ca-ad95-c2698abd9f54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:29:31.963840 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ad51fbd3-6100-40ca-ad95-c2698abd9f54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:31.970267 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad51fbd3-6100-40ca-ad95-c2698abd9f54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:31.971539 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad51fbd3-6100-40ca-ad95-c2698abd9f54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:31.971737 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad51fbd3-6100-40ca-ad95-c2698abd9f54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:31.972455 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad51fbd3-6100-40ca-ad95-c2698abd9f54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:31.972905 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad51fbd3-6100-40ca-ad95-c2698abd9f54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:31.973323 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ad51fbd3-6100-40ca-ad95-c2698abd9f54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:31.987433 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:SELECT=87,nova_cell1:INSERT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:31.995900 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2e99d5c4-c17f-44ca-9f6e-45863f63f5b1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:31.996536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2e99d5c4-c17f-44ca-9f6e-45863f63f5b1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:32.003457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e99d5c4-c17f-44ca-9f6e-45863f63f5b1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:32.003946 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e99d5c4-c17f-44ca-9f6e-45863f63f5b1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:32.004501 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e99d5c4-c17f-44ca-9f6e-45863f63f5b1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:32.005270 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e99d5c4-c17f-44ca-9f6e-45863f63f5b1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:32.005726 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e99d5c4-c17f-44ca-9f6e-45863f63f5b1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:32.006369 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2e99d5c4-c17f-44ca-9f6e-45863f63f5b1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:32.020959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ad51fbd3-6100-40ca-ad95-c2698abd9f54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117920) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 02:29:32.092879 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ad51fbd3-6100-40ca-ad95-c2698abd9f54 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "POST /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1/action" status: 202 len: 0 microversion: 2.20 time: 0.133673 Aug 05 02:29:32.093872 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 518/1034] 10.222.0.15 () {62 vars in 1319 bytes} [Fri Aug 5 02:29:31 2022] POST /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:29:32.102539 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-44a0762b-c5fd-4ec4-a560-c8fb83064859 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:32.103214 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-44a0762b-c5fd-4ec4-a560-c8fb83064859 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:32.109772 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-44a0762b-c5fd-4ec4-a560-c8fb83064859 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:32.110322 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-44a0762b-c5fd-4ec4-a560-c8fb83064859 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:32.110972 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-44a0762b-c5fd-4ec4-a560-c8fb83064859 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:32.111917 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-44a0762b-c5fd-4ec4-a560-c8fb83064859 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:32.112588 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-44a0762b-c5fd-4ec4-a560-c8fb83064859 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:32.113197 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-44a0762b-c5fd-4ec4-a560-c8fb83064859 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:32.141338 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2e99d5c4-c17f-44ca-9f6e-45863f63f5b1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:32.150503 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2e99d5c4-c17f-44ca-9f6e-45863f63f5b1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 200 len: 1513 microversion: 2.1 time: 0.158545 Aug 05 02:29:32.151072 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 517/1035] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:29:31 2022] GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:29:32.250045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-44a0762b-c5fd-4ec4-a560-c8fb83064859 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:32.258189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-44a0762b-c5fd-4ec4-a560-c8fb83064859 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:32.259640 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-44a0762b-c5fd-4ec4-a560-c8fb83064859 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:32.260838 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-44a0762b-c5fd-4ec4-a560-c8fb83064859 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1672 microversion: 2.20 time: 0.162307 Aug 05 02:29:32.261385 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 519/1036] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:32 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:33.171998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-51c941bd-ee61-4503-b079-cc495557b0b6 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:33.172751 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-51c941bd-ee61-4503-b079-cc495557b0b6 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:33.181207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51c941bd-ee61-4503-b079-cc495557b0b6 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:33.182081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51c941bd-ee61-4503-b079-cc495557b0b6 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:33.182688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51c941bd-ee61-4503-b079-cc495557b0b6 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:33.183555 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51c941bd-ee61-4503-b079-cc495557b0b6 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:33.184005 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51c941bd-ee61-4503-b079-cc495557b0b6 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:33.184447 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-51c941bd-ee61-4503-b079-cc495557b0b6 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:33.284700 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-663013b0-8075-4db6-b69c-be323908b1f3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:33.285423 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-663013b0-8075-4db6-b69c-be323908b1f3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:33.293066 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-663013b0-8075-4db6-b69c-be323908b1f3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:33.293663 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-663013b0-8075-4db6-b69c-be323908b1f3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:33.294160 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-663013b0-8075-4db6-b69c-be323908b1f3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:33.295238 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-663013b0-8075-4db6-b69c-be323908b1f3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:33.295871 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-663013b0-8075-4db6-b69c-be323908b1f3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:33.296296 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-663013b0-8075-4db6-b69c-be323908b1f3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:33.418135 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-51c941bd-ee61-4503-b079-cc495557b0b6 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:33.428227 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-51c941bd-ee61-4503-b079-cc495557b0b6 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 200 len: 1513 microversion: 2.1 time: 0.260985 Aug 05 02:29:33.429275 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 518/1037] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:29:33 2022] GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 1513 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:33.444493 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-663013b0-8075-4db6-b69c-be323908b1f3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:33.454009 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-663013b0-8075-4db6-b69c-be323908b1f3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:33.456887 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-663013b0-8075-4db6-b69c-be323908b1f3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:33.458274 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-663013b0-8075-4db6-b69c-be323908b1f3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1674 microversion: 2.20 time: 0.177971 Aug 05 02:29:33.459050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 520/1038] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:33 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:29:33.547075 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-6d5b6532-9b2c-4d87-a66b-203a94c72c67 req-96d6599a-2e4d-4deb-a664-3dbec1eb01e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8f5d3f-23c3-4e26-a9e2-78c610209aa1", "name": "network-vif-deleted", "tag": "66177fbd-6947-4a08-a7d0-b06472880f9f"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:29:33.556779 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-6d5b6532-9b2c-4d87-a66b-203a94c72c67 req-96d6599a-2e4d-4deb-a664-3dbec1eb01e0 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:33.557250 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-6d5b6532-9b2c-4d87-a66b-203a94c72c67 req-96d6599a-2e4d-4deb-a664-3dbec1eb01e0 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:33.557681 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-6d5b6532-9b2c-4d87-a66b-203a94c72c67 req-96d6599a-2e4d-4deb-a664-3dbec1eb01e0 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:33.568362 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-6d5b6532-9b2c-4d87-a66b-203a94c72c67 req-96d6599a-2e4d-4deb-a664-3dbec1eb01e0 service nova] Creating event network-vif-deleted:66177fbd-6947-4a08-a7d0-b06472880f9f for instance bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 on hv-cinder-81558 Aug 05 02:29:33.573090 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-6d5b6532-9b2c-4d87-a66b-203a94c72c67 req-96d6599a-2e4d-4deb-a664-3dbec1eb01e0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029774 Aug 05 02:29:33.573645 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 519/1039] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:29:34.450452 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f5d5aab2-8953-4172-9485-75f71ce3d1a1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:34.451066 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f5d5aab2-8953-4172-9485-75f71ce3d1a1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: bd8f5d3f-23c3-4e26-a9e2-78c610209aa1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:34.458136 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5d5aab2-8953-4172-9485-75f71ce3d1a1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:34.458614 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5d5aab2-8953-4172-9485-75f71ce3d1a1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:34.459042 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5d5aab2-8953-4172-9485-75f71ce3d1a1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:34.459728 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5d5aab2-8953-4172-9485-75f71ce3d1a1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:34.460175 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5d5aab2-8953-4172-9485-75f71ce3d1a1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:34.460616 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5d5aab2-8953-4172-9485-75f71ce3d1a1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:34.474655 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-f5d5aab2-8953-4172-9485-75f71ce3d1a1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] HTTP exception thrown: Instance bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 could not be found. Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f5d5aab2-8953-4172-9485-75f71ce3d1a1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Request method failure captured: Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 HTTP/1.1 Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7IBAO14zDWMAhHWtQJOeQs0Ja-cpMaAPsrx2Tu_JUBAWAmm0fB8RP8HrWH0FREDnIUVrrm73a5BjxISehcdYqjyljxlGPWP030jy2C2arU7Qm8_OHmFJlptvrzndzVSXXngmYgMO8L_wLF1tLle_ujlUEzB_R4VW_uE9jYgKWGf-5ZU Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 8aeb435284914740b100d506c74bad6b Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1364126693 Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:29:34.476520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:29:34.477942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8aeb435284914740b100d506c74bad6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8aeb435284914740b100d506c74bad6b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8aeb435284914740b100d506c74bad6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8aeb435284914740b100d506c74bad6b"}]}] Aug 05 02:29:34.477942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesSnapshotTestJSON-1364126693 Aug 05 02:29:34.477942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 8aeb435284914740b100d506c74bad6b Aug 05 02:29:34.477942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1364126693 Aug 05 02:29:34.477942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesSnapshotTestJSON-1364126693-project Aug 05 02:29:34.477942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:29:34.477942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:29:34.477942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: bf4c0ebf69394f49abfb31e297dafccf Aug 05 02:29:34.477942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesSnapshotTestJSON-1364126693-project Aug 05 02:29:34.477942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:29:34.477942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 could not be found. Aug 05 02:29:34.477942 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': 'bd8f5d3f-23c3-4e26-a9e2-78c610209aa1'} Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 could not be found. Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:29:34.478884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 could not be found. Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 could not be found. Aug 05 02:29:34.480625 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:29:34.489791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f5d5aab2-8953-4172-9485-75f71ce3d1a1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Returning 404 to user: Instance bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:29:34.489791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f5d5aab2-8953-4172-9485-75f71ce3d1a1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1" status: 404 len: 111 microversion: 2.1 time: 0.031432 Aug 05 02:29:34.489791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 521/1040] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:29:34 2022] GET /compute/v2.1/servers/bd8f5d3f-23c3-4e26-a9e2-78c610209aa1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:29:34.490072 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-409f9fed-e616-4855-ad27-112c2e3d0764 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:34.490072 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-409f9fed-e616-4855-ad27-112c2e3d0764 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:34.496522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-409f9fed-e616-4855-ad27-112c2e3d0764 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:34.497142 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-409f9fed-e616-4855-ad27-112c2e3d0764 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:34.497642 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-409f9fed-e616-4855-ad27-112c2e3d0764 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:34.498470 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-409f9fed-e616-4855-ad27-112c2e3d0764 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:34.498982 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-409f9fed-e616-4855-ad27-112c2e3d0764 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:34.499465 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-409f9fed-e616-4855-ad27-112c2e3d0764 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:34.709829 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-409f9fed-e616-4855-ad27-112c2e3d0764 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:34.718361 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-409f9fed-e616-4855-ad27-112c2e3d0764 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:34.719863 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-409f9fed-e616-4855-ad27-112c2e3d0764 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:34.722258 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-409f9fed-e616-4855-ad27-112c2e3d0764 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.242188 Aug 05 02:29:34.722825 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 520/1041] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:34 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:35.745140 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb746863-863b-4fc3-afc0-07bffcfe1ddb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:35.745746 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cb746863-863b-4fc3-afc0-07bffcfe1ddb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:35.753111 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb746863-863b-4fc3-afc0-07bffcfe1ddb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:35.753603 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb746863-863b-4fc3-afc0-07bffcfe1ddb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:35.754044 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb746863-863b-4fc3-afc0-07bffcfe1ddb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:35.754742 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb746863-863b-4fc3-afc0-07bffcfe1ddb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:35.755199 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb746863-863b-4fc3-afc0-07bffcfe1ddb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:35.755626 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb746863-863b-4fc3-afc0-07bffcfe1ddb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:35.889617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb746863-863b-4fc3-afc0-07bffcfe1ddb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:35.898736 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb746863-863b-4fc3-afc0-07bffcfe1ddb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:35.900250 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb746863-863b-4fc3-afc0-07bffcfe1ddb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:35.901475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb746863-863b-4fc3-afc0-07bffcfe1ddb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.160187 Aug 05 02:29:35.902033 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 522/1042] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:35 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:36.924203 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ce85b1c0-cb2f-439f-8ee0-1cc30463a66a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:36.925435 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ce85b1c0-cb2f-439f-8ee0-1cc30463a66a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:36.932784 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ce85b1c0-cb2f-439f-8ee0-1cc30463a66a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:36.933635 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ce85b1c0-cb2f-439f-8ee0-1cc30463a66a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:36.934472 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ce85b1c0-cb2f-439f-8ee0-1cc30463a66a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:36.935566 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ce85b1c0-cb2f-439f-8ee0-1cc30463a66a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:36.936393 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ce85b1c0-cb2f-439f-8ee0-1cc30463a66a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:36.937114 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ce85b1c0-cb2f-439f-8ee0-1cc30463a66a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:37.082173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ce85b1c0-cb2f-439f-8ee0-1cc30463a66a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:37.092353 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ce85b1c0-cb2f-439f-8ee0-1cc30463a66a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:37.094641 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ce85b1c0-cb2f-439f-8ee0-1cc30463a66a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:37.096232 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ce85b1c0-cb2f-439f-8ee0-1cc30463a66a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.175826 Aug 05 02:29:37.100726 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 521/1043] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:36 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:38.119879 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b3578b5d-e340-4f59-a5d1-62c2021bd403 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:38.120781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b3578b5d-e340-4f59-a5d1-62c2021bd403 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:38.130591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3578b5d-e340-4f59-a5d1-62c2021bd403 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:38.131072 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3578b5d-e340-4f59-a5d1-62c2021bd403 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:38.131519 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3578b5d-e340-4f59-a5d1-62c2021bd403 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:38.132230 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3578b5d-e340-4f59-a5d1-62c2021bd403 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:38.132716 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3578b5d-e340-4f59-a5d1-62c2021bd403 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:38.133145 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3578b5d-e340-4f59-a5d1-62c2021bd403 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:38.272741 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b3578b5d-e340-4f59-a5d1-62c2021bd403 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:38.280958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b3578b5d-e340-4f59-a5d1-62c2021bd403 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:38.282777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b3578b5d-e340-4f59-a5d1-62c2021bd403 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:38.284005 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b3578b5d-e340-4f59-a5d1-62c2021bd403 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.168050 Aug 05 02:29:38.285755 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 523/1044] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:38 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:39.325470 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f7b304d5-36cf-4b32-8d6a-bd56f37c2202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:39.326084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f7b304d5-36cf-4b32-8d6a-bd56f37c2202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:39.334588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7b304d5-36cf-4b32-8d6a-bd56f37c2202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:39.335099 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7b304d5-36cf-4b32-8d6a-bd56f37c2202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:39.335507 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7b304d5-36cf-4b32-8d6a-bd56f37c2202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:39.336215 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7b304d5-36cf-4b32-8d6a-bd56f37c2202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:39.337246 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7b304d5-36cf-4b32-8d6a-bd56f37c2202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:39.337814 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7b304d5-36cf-4b32-8d6a-bd56f37c2202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:39.486575 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f7b304d5-36cf-4b32-8d6a-bd56f37c2202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:39.495453 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f7b304d5-36cf-4b32-8d6a-bd56f37c2202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:39.497001 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f7b304d5-36cf-4b32-8d6a-bd56f37c2202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:39.498150 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f7b304d5-36cf-4b32-8d6a-bd56f37c2202 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.176712 Aug 05 02:29:39.498713 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 522/1045] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:39 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:40.523987 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0a0af7b9-7380-48ea-af37-c0e4bdefee99 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:40.525154 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0a0af7b9-7380-48ea-af37-c0e4bdefee99 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:40.530853 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a0af7b9-7380-48ea-af37-c0e4bdefee99 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:40.531333 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a0af7b9-7380-48ea-af37-c0e4bdefee99 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:40.531763 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a0af7b9-7380-48ea-af37-c0e4bdefee99 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:40.532490 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a0af7b9-7380-48ea-af37-c0e4bdefee99 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:40.532938 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a0af7b9-7380-48ea-af37-c0e4bdefee99 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:40.533356 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a0af7b9-7380-48ea-af37-c0e4bdefee99 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:40.682641 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0a0af7b9-7380-48ea-af37-c0e4bdefee99 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:40.692252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0a0af7b9-7380-48ea-af37-c0e4bdefee99 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:40.694051 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0a0af7b9-7380-48ea-af37-c0e4bdefee99 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:40.695408 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0a0af7b9-7380-48ea-af37-c0e4bdefee99 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.176607 Aug 05 02:29:40.706046 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 524/1046] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:40 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:41.721671 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e9b8c038-5096-4f10-bcc9-e6bf656ee186 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:41.723351 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e9b8c038-5096-4f10-bcc9-e6bf656ee186 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:41.730112 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9b8c038-5096-4f10-bcc9-e6bf656ee186 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:41.730728 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9b8c038-5096-4f10-bcc9-e6bf656ee186 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:41.731227 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9b8c038-5096-4f10-bcc9-e6bf656ee186 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:41.731973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9b8c038-5096-4f10-bcc9-e6bf656ee186 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:41.732565 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9b8c038-5096-4f10-bcc9-e6bf656ee186 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:41.733032 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e9b8c038-5096-4f10-bcc9-e6bf656ee186 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:41.866512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e9b8c038-5096-4f10-bcc9-e6bf656ee186 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:41.874680 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e9b8c038-5096-4f10-bcc9-e6bf656ee186 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:41.876183 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e9b8c038-5096-4f10-bcc9-e6bf656ee186 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:41.877400 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e9b8c038-5096-4f10-bcc9-e6bf656ee186 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.159700 Aug 05 02:29:41.878411 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 523/1047] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:41 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:42.901236 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9a9964d3-37e9-4860-818f-4f4f6be57fde tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:42.901868 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9a9964d3-37e9-4860-818f-4f4f6be57fde tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:42.908475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a9964d3-37e9-4860-818f-4f4f6be57fde tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:42.908952 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a9964d3-37e9-4860-818f-4f4f6be57fde tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:42.909967 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a9964d3-37e9-4860-818f-4f4f6be57fde tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:42.910823 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a9964d3-37e9-4860-818f-4f4f6be57fde tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:42.911275 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a9964d3-37e9-4860-818f-4f4f6be57fde tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:42.911719 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9a9964d3-37e9-4860-818f-4f4f6be57fde tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:43.058098 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9a9964d3-37e9-4860-818f-4f4f6be57fde tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:43.066684 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9a9964d3-37e9-4860-818f-4f4f6be57fde tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:43.068307 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9a9964d3-37e9-4860-818f-4f4f6be57fde tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:43.069507 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9a9964d3-37e9-4860-818f-4f4f6be57fde tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.172247 Aug 05 02:29:43.070061 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 525/1048] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:42 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:44.093674 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-de1445d1-0c4c-460d-89e3-14adf99a2bd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:44.094248 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-de1445d1-0c4c-460d-89e3-14adf99a2bd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:44.101353 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-de1445d1-0c4c-460d-89e3-14adf99a2bd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:44.101828 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-de1445d1-0c4c-460d-89e3-14adf99a2bd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:44.102256 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-de1445d1-0c4c-460d-89e3-14adf99a2bd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:44.102933 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-de1445d1-0c4c-460d-89e3-14adf99a2bd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:44.103382 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-de1445d1-0c4c-460d-89e3-14adf99a2bd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:44.103794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-de1445d1-0c4c-460d-89e3-14adf99a2bd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:44.231641 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-de1445d1-0c4c-460d-89e3-14adf99a2bd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:44.241161 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-de1445d1-0c4c-460d-89e3-14adf99a2bd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:44.242976 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-de1445d1-0c4c-460d-89e3-14adf99a2bd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:44.244560 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-de1445d1-0c4c-460d-89e3-14adf99a2bd9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.154774 Aug 05 02:29:44.245118 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 524/1049] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:44 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:45.267189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-616861ff-6c81-4561-9b1b-ce580fced7b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:45.267776 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-616861ff-6c81-4561-9b1b-ce580fced7b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:45.274713 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-616861ff-6c81-4561-9b1b-ce580fced7b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:45.275200 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-616861ff-6c81-4561-9b1b-ce580fced7b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:45.275914 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-616861ff-6c81-4561-9b1b-ce580fced7b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:45.276965 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-616861ff-6c81-4561-9b1b-ce580fced7b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:45.277653 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-616861ff-6c81-4561-9b1b-ce580fced7b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:45.278331 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-616861ff-6c81-4561-9b1b-ce580fced7b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:45.424098 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-616861ff-6c81-4561-9b1b-ce580fced7b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:45.433780 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-616861ff-6c81-4561-9b1b-ce580fced7b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:45.435440 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-616861ff-6c81-4561-9b1b-ce580fced7b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:45.436741 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-616861ff-6c81-4561-9b1b-ce580fced7b3 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.173428 Aug 05 02:29:45.437294 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 526/1050] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:45 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:46.460874 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-99aacbfc-2d3c-42c7-b4a8-ab223f5529ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:46.461470 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-99aacbfc-2d3c-42c7-b4a8-ab223f5529ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:46.468050 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99aacbfc-2d3c-42c7-b4a8-ab223f5529ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:46.468551 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99aacbfc-2d3c-42c7-b4a8-ab223f5529ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:46.468979 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99aacbfc-2d3c-42c7-b4a8-ab223f5529ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:46.469651 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99aacbfc-2d3c-42c7-b4a8-ab223f5529ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:46.470092 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99aacbfc-2d3c-42c7-b4a8-ab223f5529ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:46.470506 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-99aacbfc-2d3c-42c7-b4a8-ab223f5529ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:46.475007 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:46.606366 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-99aacbfc-2d3c-42c7-b4a8-ab223f5529ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:46.634625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-99aacbfc-2d3c-42c7-b4a8-ab223f5529ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:46.636113 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-99aacbfc-2d3c-42c7-b4a8-ab223f5529ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:46.637377 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-99aacbfc-2d3c-42c7-b4a8-ab223f5529ff tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.180408 Aug 05 02:29:46.637925 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 525/1051] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:46 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:47.661008 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ae7127a3-0dbd-45e8-bbe1-3d5899b43850 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:47.661545 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ae7127a3-0dbd-45e8-bbe1-3d5899b43850 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:47.667925 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae7127a3-0dbd-45e8-bbe1-3d5899b43850 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:47.668428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae7127a3-0dbd-45e8-bbe1-3d5899b43850 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:47.668860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae7127a3-0dbd-45e8-bbe1-3d5899b43850 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:47.669538 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae7127a3-0dbd-45e8-bbe1-3d5899b43850 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:47.669983 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae7127a3-0dbd-45e8-bbe1-3d5899b43850 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:47.670402 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ae7127a3-0dbd-45e8-bbe1-3d5899b43850 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:47.796584 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ae7127a3-0dbd-45e8-bbe1-3d5899b43850 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:47.804696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ae7127a3-0dbd-45e8-bbe1-3d5899b43850 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:47.806221 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ae7127a3-0dbd-45e8-bbe1-3d5899b43850 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:47.807358 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ae7127a3-0dbd-45e8-bbe1-3d5899b43850 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.150373 Aug 05 02:29:47.807914 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 527/1052] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:47 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:48.830787 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f117ea13-eb56-4049-ad0e-bbbd14bf5b5d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:48.831321 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f117ea13-eb56-4049-ad0e-bbbd14bf5b5d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:48.839400 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f117ea13-eb56-4049-ad0e-bbbd14bf5b5d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:48.839879 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f117ea13-eb56-4049-ad0e-bbbd14bf5b5d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:48.840313 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f117ea13-eb56-4049-ad0e-bbbd14bf5b5d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:48.841026 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f117ea13-eb56-4049-ad0e-bbbd14bf5b5d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:48.841476 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f117ea13-eb56-4049-ad0e-bbbd14bf5b5d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:48.841895 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f117ea13-eb56-4049-ad0e-bbbd14bf5b5d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:48.980166 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f117ea13-eb56-4049-ad0e-bbbd14bf5b5d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:48.990080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f117ea13-eb56-4049-ad0e-bbbd14bf5b5d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:48.993699 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f117ea13-eb56-4049-ad0e-bbbd14bf5b5d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:48.995330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f117ea13-eb56-4049-ad0e-bbbd14bf5b5d tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.168483 Aug 05 02:29:48.996132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 526/1053] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:48 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:49.538681 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1948090318", "imageRef": "38c4b879-6810-4c2a-92ec-d209ead0d089", "flavorRef": "452", "networks": [{"uuid": "fa472d95-83d0-4e82-b169-3c906c731c37"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:29:49.598877 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] validate_networks() for [('fa472d95-83d0-4e82-b169-3c906c731c37', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:29:49.953083 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:29:49.953541 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:29:49.954091 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:29:49.954575 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:29:49.955067 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:29:49.979485 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:49.979897 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:49.980396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:49.981082 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:49.981534 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:49.981965 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:50.004045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Getting quotas for project 8aeb435284914740b100d506c74bad6b. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:29:50.008674 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Getting quotas for user bf4c0ebf69394f49abfb31e297dafccf and project 8aeb435284914740b100d506c74bad6b. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:29:50.019600 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:29:50.023573 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e5c84da6-cd47-4f44-8b7a-35b06b135bdd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:50.024464 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e5c84da6-cd47-4f44-8b7a-35b06b135bdd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:50.024704 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38c4b879-6810-4c2a-92ec-d209ead0d089',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:29:50.030799 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5c84da6-cd47-4f44-8b7a-35b06b135bdd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:50.031281 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5c84da6-cd47-4f44-8b7a-35b06b135bdd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:50.031713 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5c84da6-cd47-4f44-8b7a-35b06b135bdd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:50.032438 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5c84da6-cd47-4f44-8b7a-35b06b135bdd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:50.032888 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5c84da6-cd47-4f44-8b7a-35b06b135bdd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:50.033307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e5c84da6-cd47-4f44-8b7a-35b06b135bdd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:50.091433 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d0291822-296f-4380-bcd3-90e892676bf9 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556759 Aug 05 02:29:50.092427 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 528/1054] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:29:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:29:50.108118 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d55e6964-5b21-4ce5-9d5e-70dfd03e218a tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:50.108998 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d55e6964-5b21-4ce5-9d5e-70dfd03e218a tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:50.177759 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d55e6964-5b21-4ce5-9d5e-70dfd03e218a tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:50.199550 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d55e6964-5b21-4ce5-9d5e-70dfd03e218a tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1219 microversion: 2.1 time: 0.100426 Aug 05 02:29:50.200390 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 529/1055] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:29:50 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:50.237604 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e5c84da6-cd47-4f44-8b7a-35b06b135bdd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:50.246998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e5c84da6-cd47-4f44-8b7a-35b06b135bdd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:50.248876 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e5c84da6-cd47-4f44-8b7a-35b06b135bdd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:50.250048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e5c84da6-cd47-4f44-8b7a-35b06b135bdd tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.230338 Aug 05 02:29:50.251411 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 527/1056] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:50 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:51.221502 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b9ec4daa-db10-40fe-9710-6ccd4e503704 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:51.222109 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b9ec4daa-db10-40fe-9710-6ccd4e503704 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:51.229250 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9ec4daa-db10-40fe-9710-6ccd4e503704 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:51.229725 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9ec4daa-db10-40fe-9710-6ccd4e503704 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:51.230153 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9ec4daa-db10-40fe-9710-6ccd4e503704 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:51.230832 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9ec4daa-db10-40fe-9710-6ccd4e503704 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:51.231275 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9ec4daa-db10-40fe-9710-6ccd4e503704 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:51.231692 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b9ec4daa-db10-40fe-9710-6ccd4e503704 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:51.274399 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-e76726ee-0905-420b-a7b9-260edd3aef77 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:51.274990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-e76726ee-0905-420b-a7b9-260edd3aef77 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:51.281247 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e76726ee-0905-420b-a7b9-260edd3aef77 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:51.281725 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e76726ee-0905-420b-a7b9-260edd3aef77 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:51.282154 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e76726ee-0905-420b-a7b9-260edd3aef77 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:51.282838 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e76726ee-0905-420b-a7b9-260edd3aef77 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:51.283281 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e76726ee-0905-420b-a7b9-260edd3aef77 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:51.283694 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-e76726ee-0905-420b-a7b9-260edd3aef77 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:51.294677 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b9ec4daa-db10-40fe-9710-6ccd4e503704 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:51.302075 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b9ec4daa-db10-40fe-9710-6ccd4e503704 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1223 microversion: 2.1 time: 0.084452 Aug 05 02:29:51.302640 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 530/1057] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:29:51 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:51.411642 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e76726ee-0905-420b-a7b9-260edd3aef77 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:51.419336 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e76726ee-0905-420b-a7b9-260edd3aef77 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:51.420849 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-e76726ee-0905-420b-a7b9-260edd3aef77 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:51.421988 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-e76726ee-0905-420b-a7b9-260edd3aef77 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.151991 Aug 05 02:29:51.422539 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 528/1058] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:51 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 05 02:29:52.322399 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-41eb3bb3-ac5f-42ae-ab62-660c9b903e1b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:52.323012 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-41eb3bb3-ac5f-42ae-ab62-660c9b903e1b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:52.329455 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41eb3bb3-ac5f-42ae-ab62-660c9b903e1b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:52.329930 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41eb3bb3-ac5f-42ae-ab62-660c9b903e1b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:52.330367 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41eb3bb3-ac5f-42ae-ab62-660c9b903e1b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:52.331048 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41eb3bb3-ac5f-42ae-ab62-660c9b903e1b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:52.331499 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41eb3bb3-ac5f-42ae-ab62-660c9b903e1b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:52.331920 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-41eb3bb3-ac5f-42ae-ab62-660c9b903e1b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:52.391920 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-41eb3bb3-ac5f-42ae-ab62-660c9b903e1b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:52.399274 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-41eb3bb3-ac5f-42ae-ab62-660c9b903e1b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1215 microversion: 2.1 time: 0.080941 Aug 05 02:29:52.400025 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 531/1059] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:29:52 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:52.445140 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-88e4936e-7dcf-487e-bf44-4a6bf1a8b82c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:52.445742 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-88e4936e-7dcf-487e-bf44-4a6bf1a8b82c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:52.451980 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88e4936e-7dcf-487e-bf44-4a6bf1a8b82c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:52.452493 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88e4936e-7dcf-487e-bf44-4a6bf1a8b82c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:52.452921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88e4936e-7dcf-487e-bf44-4a6bf1a8b82c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:52.453597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88e4936e-7dcf-487e-bf44-4a6bf1a8b82c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:52.454041 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88e4936e-7dcf-487e-bf44-4a6bf1a8b82c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:52.454457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-88e4936e-7dcf-487e-bf44-4a6bf1a8b82c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:52.581812 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-88e4936e-7dcf-487e-bf44-4a6bf1a8b82c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:52.590422 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-88e4936e-7dcf-487e-bf44-4a6bf1a8b82c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:52.591901 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-88e4936e-7dcf-487e-bf44-4a6bf1a8b82c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:52.593112 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-88e4936e-7dcf-487e-bf44-4a6bf1a8b82c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.152237 Aug 05 02:29:52.593661 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 529/1060] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:52 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:53.420786 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e830efe5-1e78-43ab-9295-126f57259e48 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:53.421319 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e830efe5-1e78-43ab-9295-126f57259e48 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:53.427674 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e830efe5-1e78-43ab-9295-126f57259e48 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:53.428152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e830efe5-1e78-43ab-9295-126f57259e48 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:53.429202 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e830efe5-1e78-43ab-9295-126f57259e48 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:53.430013 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e830efe5-1e78-43ab-9295-126f57259e48 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:53.430475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e830efe5-1e78-43ab-9295-126f57259e48 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:53.430902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e830efe5-1e78-43ab-9295-126f57259e48 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:53.492759 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e830efe5-1e78-43ab-9295-126f57259e48 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:53.500012 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e830efe5-1e78-43ab-9295-126f57259e48 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1215 microversion: 2.1 time: 0.083118 Aug 05 02:29:53.500604 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 532/1061] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:29:53 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:53.621989 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-efc122e2-2779-4e33-a269-f2b6083fdaee tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:53.622813 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-efc122e2-2779-4e33-a269-f2b6083fdaee tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:53.629066 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-efc122e2-2779-4e33-a269-f2b6083fdaee tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:53.629540 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-efc122e2-2779-4e33-a269-f2b6083fdaee tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:53.629971 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-efc122e2-2779-4e33-a269-f2b6083fdaee tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:53.630652 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-efc122e2-2779-4e33-a269-f2b6083fdaee tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:53.631100 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-efc122e2-2779-4e33-a269-f2b6083fdaee tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:53.631521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-efc122e2-2779-4e33-a269-f2b6083fdaee tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:53.766927 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-efc122e2-2779-4e33-a269-f2b6083fdaee tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:53.775327 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-efc122e2-2779-4e33-a269-f2b6083fdaee tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:53.776870 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-efc122e2-2779-4e33-a269-f2b6083fdaee tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:53.778028 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-efc122e2-2779-4e33-a269-f2b6083fdaee tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.160627 Aug 05 02:29:53.778585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 530/1062] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:53 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:54.521184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7267ba2e-31e2-4122-bdf8-433abea2bc91 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:54.521836 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7267ba2e-31e2-4122-bdf8-433abea2bc91 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:54.529623 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7267ba2e-31e2-4122-bdf8-433abea2bc91 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:54.530112 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7267ba2e-31e2-4122-bdf8-433abea2bc91 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:54.530551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7267ba2e-31e2-4122-bdf8-433abea2bc91 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:54.531267 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7267ba2e-31e2-4122-bdf8-433abea2bc91 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:54.531724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7267ba2e-31e2-4122-bdf8-433abea2bc91 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:54.532145 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7267ba2e-31e2-4122-bdf8-433abea2bc91 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:54.594550 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7267ba2e-31e2-4122-bdf8-433abea2bc91 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:54.602462 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7267ba2e-31e2-4122-bdf8-433abea2bc91 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1215 microversion: 2.1 time: 0.085189 Aug 05 02:29:54.603021 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 533/1063] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:29:54 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:54.801210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1f7884e4-8d53-401b-b4f0-624cea0c1f38 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:54.801764 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1f7884e4-8d53-401b-b4f0-624cea0c1f38 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:54.809174 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1f7884e4-8d53-401b-b4f0-624cea0c1f38 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:54.809654 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1f7884e4-8d53-401b-b4f0-624cea0c1f38 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:54.810087 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1f7884e4-8d53-401b-b4f0-624cea0c1f38 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:54.810825 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1f7884e4-8d53-401b-b4f0-624cea0c1f38 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:54.811274 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1f7884e4-8d53-401b-b4f0-624cea0c1f38 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:54.811694 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1f7884e4-8d53-401b-b4f0-624cea0c1f38 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:54.942396 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1f7884e4-8d53-401b-b4f0-624cea0c1f38 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:54.950979 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1f7884e4-8d53-401b-b4f0-624cea0c1f38 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:54.952510 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1f7884e4-8d53-401b-b4f0-624cea0c1f38 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:54.953666 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1f7884e4-8d53-401b-b4f0-624cea0c1f38 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.156467 Aug 05 02:29:54.954224 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 531/1064] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:54 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:55.623952 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-69821d30-ad63-41e4-bb6d-a5dc968ebc8f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:55.624597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-69821d30-ad63-41e4-bb6d-a5dc968ebc8f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:55.632184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-69821d30-ad63-41e4-bb6d-a5dc968ebc8f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:55.632727 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-69821d30-ad63-41e4-bb6d-a5dc968ebc8f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:55.633165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-69821d30-ad63-41e4-bb6d-a5dc968ebc8f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:55.633873 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-69821d30-ad63-41e4-bb6d-a5dc968ebc8f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:55.634331 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-69821d30-ad63-41e4-bb6d-a5dc968ebc8f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:55.634743 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-69821d30-ad63-41e4-bb6d-a5dc968ebc8f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:55.707350 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-69821d30-ad63-41e4-bb6d-a5dc968ebc8f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:55.716824 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-69821d30-ad63-41e4-bb6d-a5dc968ebc8f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1289 microversion: 2.1 time: 0.096888 Aug 05 02:29:55.717729 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 534/1065] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:29:55 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:55.977097 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0e7ec6a7-6c4e-434a-9624-762a73a25306 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:55.978369 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0e7ec6a7-6c4e-434a-9624-762a73a25306 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:55.984667 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0e7ec6a7-6c4e-434a-9624-762a73a25306 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:55.985149 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0e7ec6a7-6c4e-434a-9624-762a73a25306 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:55.985573 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0e7ec6a7-6c4e-434a-9624-762a73a25306 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:55.986259 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0e7ec6a7-6c4e-434a-9624-762a73a25306 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:55.986705 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0e7ec6a7-6c4e-434a-9624-762a73a25306 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:55.987122 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0e7ec6a7-6c4e-434a-9624-762a73a25306 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:56.206187 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0e7ec6a7-6c4e-434a-9624-762a73a25306 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:56.217774 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0e7ec6a7-6c4e-434a-9624-762a73a25306 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:56.219916 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0e7ec6a7-6c4e-434a-9624-762a73a25306 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:56.221265 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0e7ec6a7-6c4e-434a-9624-762a73a25306 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.248816 Aug 05 02:29:56.222718 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 532/1066] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:55 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:56.427352 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-845285a6-6872-4a6d-838f-a63eef6dc4f0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:56.429849 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-845285a6-6872-4a6d-838f-a63eef6dc4f0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:56.436082 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-845285a6-6872-4a6d-838f-a63eef6dc4f0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:56.436601 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-845285a6-6872-4a6d-838f-a63eef6dc4f0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:56.437056 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-845285a6-6872-4a6d-838f-a63eef6dc4f0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:56.437779 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-845285a6-6872-4a6d-838f-a63eef6dc4f0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:56.438251 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-845285a6-6872-4a6d-838f-a63eef6dc4f0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:56.438675 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-845285a6-6872-4a6d-838f-a63eef6dc4f0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:56.468609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-845285a6-6872-4a6d-838f-a63eef6dc4f0 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045511 Aug 05 02:29:56.469376 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 535/1067] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:29:56 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:29:56.606008 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-27fffd1f-5b26-4dd5-9606-36ae89aba297 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:56.606499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-27fffd1f-5b26-4dd5-9606-36ae89aba297 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:56.608411 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=44 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:56.613731 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27fffd1f-5b26-4dd5-9606-36ae89aba297 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:56.614211 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27fffd1f-5b26-4dd5-9606-36ae89aba297 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:56.614641 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27fffd1f-5b26-4dd5-9606-36ae89aba297 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:56.615322 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27fffd1f-5b26-4dd5-9606-36ae89aba297 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:56.615804 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27fffd1f-5b26-4dd5-9606-36ae89aba297 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:56.616223 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27fffd1f-5b26-4dd5-9606-36ae89aba297 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:56.646295 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-27fffd1f-5b26-4dd5-9606-36ae89aba297 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments/7cf97f20-c016-4e04-9190-f511abc6ac7b" status: 200 len: 194 microversion: 2.1 time: 0.044886 Aug 05 02:29:56.647091 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 533/1068] 10.222.0.15 () {58 vars in 1413 bytes} [Fri Aug 5 02:29:56 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments/7cf97f20-c016-4e04-9190-f511abc6ac7b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:29:56.657798 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-730328a4-2268-4e48-8a76-ad1a0133bc1a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:56.658361 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-730328a4-2268-4e48-8a76-ad1a0133bc1a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:56.665046 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-730328a4-2268-4e48-8a76-ad1a0133bc1a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:56.665533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-730328a4-2268-4e48-8a76-ad1a0133bc1a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:56.665972 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-730328a4-2268-4e48-8a76-ad1a0133bc1a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:56.666669 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-730328a4-2268-4e48-8a76-ad1a0133bc1a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:56.667127 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-730328a4-2268-4e48-8a76-ad1a0133bc1a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:56.667555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-730328a4-2268-4e48-8a76-ad1a0133bc1a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:56.683220 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:56.741049 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1704de7a-cec0-4dde-ae8a-7dfc91a4fb7f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:56.741669 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-1704de7a-cec0-4dde-ae8a-7dfc91a4fb7f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:56.748875 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1704de7a-cec0-4dde-ae8a-7dfc91a4fb7f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:56.749703 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1704de7a-cec0-4dde-ae8a-7dfc91a4fb7f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:56.750356 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1704de7a-cec0-4dde-ae8a-7dfc91a4fb7f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:56.751259 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1704de7a-cec0-4dde-ae8a-7dfc91a4fb7f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:56.751926 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1704de7a-cec0-4dde-ae8a-7dfc91a4fb7f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:56.752577 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-1704de7a-cec0-4dde-ae8a-7dfc91a4fb7f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:56.766493 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-730328a4-2268-4e48-8a76-ad1a0133bc1a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lazy-loading 'services' on Instance uuid 7a62bccf-ee14-4f75-ac75-78872dd510c8 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:29:56.870555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-730328a4-2268-4e48-8a76-ad1a0133bc1a tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments/7cf97f20-c016-4e04-9190-f511abc6ac7b" status: 202 len: 0 microversion: 2.1 time: 0.216498 Aug 05 02:29:56.871384 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 536/1069] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Aug 5 02:29:56 2022] DELETE /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments/7cf97f20-c016-4e04-9190-f511abc6ac7b => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 02:29:56.972102 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-1704de7a-cec0-4dde-ae8a-7dfc91a4fb7f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:56.986134 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1704de7a-cec0-4dde-ae8a-7dfc91a4fb7f tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1319 microversion: 2.1 time: 0.249760 Aug 05 02:29:56.987033 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 534/1070] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:29:56 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:29:57.246600 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8bc5a48a-d178-453f-90ef-9022897cd004 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:57.247328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8bc5a48a-d178-453f-90ef-9022897cd004 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:57.253451 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8bc5a48a-d178-453f-90ef-9022897cd004 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:57.253938 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8bc5a48a-d178-453f-90ef-9022897cd004 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:57.254397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8bc5a48a-d178-453f-90ef-9022897cd004 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:57.255219 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8bc5a48a-d178-453f-90ef-9022897cd004 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:57.255749 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8bc5a48a-d178-453f-90ef-9022897cd004 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:57.256292 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8bc5a48a-d178-453f-90ef-9022897cd004 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:57.276760 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-f4150505-dbbb-4cc1-833a-875695b69255 req-0187cc71-a543-448f-80e3-70bc382d97d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda05d94-80b5-4f53-b23d-2db4abf450ea", "tag": "2d8ac192-59d0-4717-855e-34a8aebbb09a"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:29:57.286817 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f4150505-dbbb-4cc1-833a-875695b69255 req-0187cc71-a543-448f-80e3-70bc382d97d0 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:57.287924 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f4150505-dbbb-4cc1-833a-875695b69255 req-0187cc71-a543-448f-80e3-70bc382d97d0 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:57.288485 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-f4150505-dbbb-4cc1-833a-875695b69255 req-0187cc71-a543-448f-80e3-70bc382d97d0 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:57.301327 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-f4150505-dbbb-4cc1-833a-875695b69255 req-0187cc71-a543-448f-80e3-70bc382d97d0 service nova] Creating event network-changed:2d8ac192-59d0-4717-855e-34a8aebbb09a for instance cda05d94-80b5-4f53-b23d-2db4abf450ea on hv-cinder-81558 Aug 05 02:29:57.306818 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-f4150505-dbbb-4cc1-833a-875695b69255 req-0187cc71-a543-448f-80e3-70bc382d97d0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034993 Aug 05 02:29:57.307687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 535/1071] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:29:57.392903 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8bc5a48a-d178-453f-90ef-9022897cd004 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:57.400771 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8bc5a48a-d178-453f-90ef-9022897cd004 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:57.402270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8bc5a48a-d178-453f-90ef-9022897cd004 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:57.403442 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8bc5a48a-d178-453f-90ef-9022897cd004 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.161537 Aug 05 02:29:57.403983 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 537/1072] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:57 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:58.007732 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-883c15bc-6ec2-4538-98b2-5f93d40c84ac tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:58.008449 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-883c15bc-6ec2-4538-98b2-5f93d40c84ac tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:58.015192 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-883c15bc-6ec2-4538-98b2-5f93d40c84ac tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:58.015670 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-883c15bc-6ec2-4538-98b2-5f93d40c84ac tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:58.016099 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-883c15bc-6ec2-4538-98b2-5f93d40c84ac tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:58.016853 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-883c15bc-6ec2-4538-98b2-5f93d40c84ac tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:58.017299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-883c15bc-6ec2-4538-98b2-5f93d40c84ac tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:58.017718 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-883c15bc-6ec2-4538-98b2-5f93d40c84ac tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:58.205979 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-11ed6353-6fac-48c8-8414-31130889d667 req-3d235de7-0fad-43e8-867e-9c8ba4211007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac84bba5-1a3a-4625-ad22-276df81d03a1", "name": "network-vif-plugged", "status": "completed", "tag": "a68b1751-4c77-41ca-80e7-300bcc5e2f50"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:29:58.213706 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:58.220992 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-11ed6353-6fac-48c8-8414-31130889d667 req-3d235de7-0fad-43e8-867e-9c8ba4211007 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:58.221755 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-11ed6353-6fac-48c8-8414-31130889d667 req-3d235de7-0fad-43e8-867e-9c8ba4211007 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:58.222349 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-11ed6353-6fac-48c8-8414-31130889d667 req-3d235de7-0fad-43e8-867e-9c8ba4211007 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:58.229664 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-883c15bc-6ec2-4538-98b2-5f93d40c84ac tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:58.237533 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-883c15bc-6ec2-4538-98b2-5f93d40c84ac tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1319 microversion: 2.1 time: 0.234273 Aug 05 02:29:58.239724 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 536/1073] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:29:58 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:58.241761 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-11ed6353-6fac-48c8-8414-31130889d667 req-3d235de7-0fad-43e8-867e-9c8ba4211007 service nova] Creating event network-vif-plugged:a68b1751-4c77-41ca-80e7-300bcc5e2f50 for instance ac84bba5-1a3a-4625-ad22-276df81d03a1 on hv-cinder-81558 Aug 05 02:29:58.247296 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-11ed6353-6fac-48c8-8414-31130889d667 req-3d235de7-0fad-43e8-867e-9c8ba4211007 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046071 Aug 05 02:29:58.248492 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 538/1074] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:29:58.427055 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8abd3031-e2be-4258-9f5e-b8ccf6feb2c1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:58.427658 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8abd3031-e2be-4258-9f5e-b8ccf6feb2c1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:58.434947 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8abd3031-e2be-4258-9f5e-b8ccf6feb2c1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:58.435708 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8abd3031-e2be-4258-9f5e-b8ccf6feb2c1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:58.436291 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8abd3031-e2be-4258-9f5e-b8ccf6feb2c1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:58.437246 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8abd3031-e2be-4258-9f5e-b8ccf6feb2c1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:58.437855 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8abd3031-e2be-4258-9f5e-b8ccf6feb2c1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:58.438437 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8abd3031-e2be-4258-9f5e-b8ccf6feb2c1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:58.724582 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8abd3031-e2be-4258-9f5e-b8ccf6feb2c1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:58.733359 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8abd3031-e2be-4258-9f5e-b8ccf6feb2c1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:58.734851 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8abd3031-e2be-4258-9f5e-b8ccf6feb2c1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:58.736037 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8abd3031-e2be-4258-9f5e-b8ccf6feb2c1 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.312909 Aug 05 02:29:58.736627 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 537/1075] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:58 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:29:59.057027 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1da9ce18-63da-4291-8331-efea41fb42cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:59.057596 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1da9ce18-63da-4291-8331-efea41fb42cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:59.063619 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1da9ce18-63da-4291-8331-efea41fb42cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:59.064090 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1da9ce18-63da-4291-8331-efea41fb42cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:59.064553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1da9ce18-63da-4291-8331-efea41fb42cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:59.065230 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1da9ce18-63da-4291-8331-efea41fb42cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:59.065678 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1da9ce18-63da-4291-8331-efea41fb42cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:59.066096 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1da9ce18-63da-4291-8331-efea41fb42cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:59.094672 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1da9ce18-63da-4291-8331-efea41fb42cb tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments/2678253e-5ccc-48e4-b23d-4dbebb4779c5" status: 200 len: 194 microversion: 2.1 time: 0.042238 Aug 05 02:29:59.095165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 539/1076] 10.222.0.15 () {58 vars in 1413 bytes} [Fri Aug 5 02:29:59 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments/2678253e-5ccc-48e4-b23d-4dbebb4779c5 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:29:59.105392 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-36cf1bbf-387c-4bdc-8fc2-645f564540d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:59.105893 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-36cf1bbf-387c-4bdc-8fc2-645f564540d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:59.112081 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-36cf1bbf-387c-4bdc-8fc2-645f564540d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:59.112582 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-36cf1bbf-387c-4bdc-8fc2-645f564540d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:59.113012 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-36cf1bbf-387c-4bdc-8fc2-645f564540d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:59.113686 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-36cf1bbf-387c-4bdc-8fc2-645f564540d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:59.114132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-36cf1bbf-387c-4bdc-8fc2-645f564540d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:59.114553 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-36cf1bbf-387c-4bdc-8fc2-645f564540d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:59.192316 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-36cf1bbf-387c-4bdc-8fc2-645f564540d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lazy-loading 'services' on Instance uuid 7a62bccf-ee14-4f75-ac75-78872dd510c8 {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:29:59.258240 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f5af4b61-9d52-4c34-b20b-296fc2a35d8b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:59.259497 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f5af4b61-9d52-4c34-b20b-296fc2a35d8b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:59.263743 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-36cf1bbf-387c-4bdc-8fc2-645f564540d6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments/2678253e-5ccc-48e4-b23d-4dbebb4779c5" status: 202 len: 0 microversion: 2.1 time: 0.162199 Aug 05 02:29:59.264346 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 538/1077] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Aug 5 02:29:59 2022] DELETE /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments/2678253e-5ccc-48e4-b23d-4dbebb4779c5 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:29:59.266024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5af4b61-9d52-4c34-b20b-296fc2a35d8b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:59.266510 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5af4b61-9d52-4c34-b20b-296fc2a35d8b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:59.266950 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5af4b61-9d52-4c34-b20b-296fc2a35d8b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:59.267676 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5af4b61-9d52-4c34-b20b-296fc2a35d8b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:59.268125 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5af4b61-9d52-4c34-b20b-296fc2a35d8b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:59.268577 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5af4b61-9d52-4c34-b20b-296fc2a35d8b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:59.415203 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f5af4b61-9d52-4c34-b20b-296fc2a35d8b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:59.422586 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f5af4b61-9d52-4c34-b20b-296fc2a35d8b tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1319 microversion: 2.1 time: 0.168150 Aug 05 02:29:59.423134 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 540/1078] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:29:59 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:29:59.759621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bb55d996-f5e2-47c0-9521-5dffbdc794b8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:29:59.760312 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bb55d996-f5e2-47c0-9521-5dffbdc794b8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:29:59.766403 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb55d996-f5e2-47c0-9521-5dffbdc794b8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:59.766882 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb55d996-f5e2-47c0-9521-5dffbdc794b8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:59.767312 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb55d996-f5e2-47c0-9521-5dffbdc794b8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:59.767998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb55d996-f5e2-47c0-9521-5dffbdc794b8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:29:59.768483 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb55d996-f5e2-47c0-9521-5dffbdc794b8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:29:59.768907 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bb55d996-f5e2-47c0-9521-5dffbdc794b8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:29:59.903600 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bb55d996-f5e2-47c0-9521-5dffbdc794b8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:59.911607 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bb55d996-f5e2-47c0-9521-5dffbdc794b8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:59.913131 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bb55d996-f5e2-47c0-9521-5dffbdc794b8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:29:59.914300 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bb55d996-f5e2-47c0-9521-5dffbdc794b8 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.158923 Aug 05 02:29:59.915432 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 539/1079] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:29:59 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:30:00.443982 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-394a0449-b482-4fc5-8f0b-6b537aaa8a61 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:00.444629 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-394a0449-b482-4fc5-8f0b-6b537aaa8a61 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:00.447305 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:00.447999 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=8 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:00.454648 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-394a0449-b482-4fc5-8f0b-6b537aaa8a61 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:00.455129 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-394a0449-b482-4fc5-8f0b-6b537aaa8a61 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:00.455563 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-394a0449-b482-4fc5-8f0b-6b537aaa8a61 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:00.456254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-394a0449-b482-4fc5-8f0b-6b537aaa8a61 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:00.456731 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-394a0449-b482-4fc5-8f0b-6b537aaa8a61 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:00.457154 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-394a0449-b482-4fc5-8f0b-6b537aaa8a61 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:00.593039 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-394a0449-b482-4fc5-8f0b-6b537aaa8a61 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:00.600353 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-394a0449-b482-4fc5-8f0b-6b537aaa8a61 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1319 microversion: 2.1 time: 0.160293 Aug 05 02:30:00.600904 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 541/1080] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:00 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:00.937785 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4f2c935f-ca3c-4219-8d9e-3e8acc6e271c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:00.938391 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4f2c935f-ca3c-4219-8d9e-3e8acc6e271c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:00.944984 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f2c935f-ca3c-4219-8d9e-3e8acc6e271c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:00.945465 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f2c935f-ca3c-4219-8d9e-3e8acc6e271c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:00.945903 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f2c935f-ca3c-4219-8d9e-3e8acc6e271c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:00.947205 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f2c935f-ca3c-4219-8d9e-3e8acc6e271c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:00.947656 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f2c935f-ca3c-4219-8d9e-3e8acc6e271c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:00.948086 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f2c935f-ca3c-4219-8d9e-3e8acc6e271c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:01.081607 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4f2c935f-ca3c-4219-8d9e-3e8acc6e271c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:01.090483 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4f2c935f-ca3c-4219-8d9e-3e8acc6e271c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:01.091913 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4f2c935f-ca3c-4219-8d9e-3e8acc6e271c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:01.093100 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4f2c935f-ca3c-4219-8d9e-3e8acc6e271c tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.159190 Aug 05 02:30:01.093659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 540/1081] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:30:00 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:30:01.621629 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c5e9825f-cc82-4c5a-acb0-49434f779e63 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:01.622322 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c5e9825f-cc82-4c5a-acb0-49434f779e63 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:01.629163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5e9825f-cc82-4c5a-acb0-49434f779e63 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:01.629651 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5e9825f-cc82-4c5a-acb0-49434f779e63 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:01.630086 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5e9825f-cc82-4c5a-acb0-49434f779e63 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:01.630777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5e9825f-cc82-4c5a-acb0-49434f779e63 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:01.631238 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5e9825f-cc82-4c5a-acb0-49434f779e63 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:01.631659 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5e9825f-cc82-4c5a-acb0-49434f779e63 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:01.760496 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c5e9825f-cc82-4c5a-acb0-49434f779e63 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:01.767804 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c5e9825f-cc82-4c5a-acb0-49434f779e63 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1319 microversion: 2.1 time: 0.150796 Aug 05 02:30:01.768479 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 542/1082] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:01 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:02.116216 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-7fcf9e40-e12d-4bf0-968f-8c9ba01fb7c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:02.116770 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-7fcf9e40-e12d-4bf0-968f-8c9ba01fb7c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:02.123716 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7fcf9e40-e12d-4bf0-968f-8c9ba01fb7c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:02.124196 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7fcf9e40-e12d-4bf0-968f-8c9ba01fb7c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:02.124674 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7fcf9e40-e12d-4bf0-968f-8c9ba01fb7c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:02.125351 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7fcf9e40-e12d-4bf0-968f-8c9ba01fb7c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:02.125795 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7fcf9e40-e12d-4bf0-968f-8c9ba01fb7c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:02.126210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-7fcf9e40-e12d-4bf0-968f-8c9ba01fb7c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:02.251801 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7fcf9e40-e12d-4bf0-968f-8c9ba01fb7c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:02.255251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:02.260743 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7fcf9e40-e12d-4bf0-968f-8c9ba01fb7c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:02.262251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-7fcf9e40-e12d-4bf0-968f-8c9ba01fb7c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:02.263414 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7fcf9e40-e12d-4bf0-968f-8c9ba01fb7c9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1730 microversion: 2.20 time: 0.151167 Aug 05 02:30:02.263972 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 541/1083] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:30:02 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:30:02.789084 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a252510d-5733-4b62-8e61-77c7bbc1979e tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:02.789698 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a252510d-5733-4b62-8e61-77c7bbc1979e tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:02.796438 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a252510d-5733-4b62-8e61-77c7bbc1979e tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:02.796929 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a252510d-5733-4b62-8e61-77c7bbc1979e tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:02.797387 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a252510d-5733-4b62-8e61-77c7bbc1979e tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:02.798164 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a252510d-5733-4b62-8e61-77c7bbc1979e tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:02.798788 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a252510d-5733-4b62-8e61-77c7bbc1979e tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:02.799224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a252510d-5733-4b62-8e61-77c7bbc1979e tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:02.939261 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a252510d-5733-4b62-8e61-77c7bbc1979e tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:02.947095 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a252510d-5733-4b62-8e61-77c7bbc1979e tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1319 microversion: 2.1 time: 0.161806 Aug 05 02:30:02.947664 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 543/1084] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:02 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:03.285752 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0fcaa88d-071a-43ed-8ea9-9630e8a54026 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:03.286352 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0fcaa88d-071a-43ed-8ea9-9630e8a54026 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:03.294148 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fcaa88d-071a-43ed-8ea9-9630e8a54026 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:03.294649 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fcaa88d-071a-43ed-8ea9-9630e8a54026 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:03.295077 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fcaa88d-071a-43ed-8ea9-9630e8a54026 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:03.295757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fcaa88d-071a-43ed-8ea9-9630e8a54026 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:03.296201 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fcaa88d-071a-43ed-8ea9-9630e8a54026 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:03.296648 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0fcaa88d-071a-43ed-8ea9-9630e8a54026 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:03.429375 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0fcaa88d-071a-43ed-8ea9-9630e8a54026 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:03.438742 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0fcaa88d-071a-43ed-8ea9-9630e8a54026 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:03.440241 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-0fcaa88d-071a-43ed-8ea9-9630e8a54026 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:03.441426 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0fcaa88d-071a-43ed-8ea9-9630e8a54026 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1717 microversion: 2.20 time: 0.159515 Aug 05 02:30:03.441980 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 542/1085] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:30:03 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:30:03.617282 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1bcc448a-8efd-4f49-a230-9d7d24383d80 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:03.619650 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1bcc448a-8efd-4f49-a230-9d7d24383d80 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:03.625902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bcc448a-8efd-4f49-a230-9d7d24383d80 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:03.626375 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bcc448a-8efd-4f49-a230-9d7d24383d80 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:03.626813 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bcc448a-8efd-4f49-a230-9d7d24383d80 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:03.627498 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bcc448a-8efd-4f49-a230-9d7d24383d80 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:03.627947 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bcc448a-8efd-4f49-a230-9d7d24383d80 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:03.628391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bcc448a-8efd-4f49-a230-9d7d24383d80 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:03.656243 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1bcc448a-8efd-4f49-a230-9d7d24383d80 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042908 Aug 05 02:30:03.656824 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 544/1086] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:30:03 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 02:30:03.766348 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-dbf7f5b6-67c4-44f4-a35d-63927a0157d8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:03.768558 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dbf7f5b6-67c4-44f4-a35d-63927a0157d8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:03.774406 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbf7f5b6-67c4-44f4-a35d-63927a0157d8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:03.774885 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbf7f5b6-67c4-44f4-a35d-63927a0157d8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:03.775851 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbf7f5b6-67c4-44f4-a35d-63927a0157d8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:03.776591 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbf7f5b6-67c4-44f4-a35d-63927a0157d8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:03.777045 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbf7f5b6-67c4-44f4-a35d-63927a0157d8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:03.777467 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dbf7f5b6-67c4-44f4-a35d-63927a0157d8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:03.806022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-dbf7f5b6-67c4-44f4-a35d-63927a0157d8 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043669 Aug 05 02:30:03.806668 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 543/1087] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:30:03 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 02:30:03.868079 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-43b1d774-7877-4fa5-b7ff-564e60bc8d3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:03.868630 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-43b1d774-7877-4fa5-b7ff-564e60bc8d3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:03.874863 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43b1d774-7877-4fa5-b7ff-564e60bc8d3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:03.875336 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43b1d774-7877-4fa5-b7ff-564e60bc8d3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:03.875769 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43b1d774-7877-4fa5-b7ff-564e60bc8d3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:03.876474 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43b1d774-7877-4fa5-b7ff-564e60bc8d3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:03.876928 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43b1d774-7877-4fa5-b7ff-564e60bc8d3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:03.877348 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-43b1d774-7877-4fa5-b7ff-564e60bc8d3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:03.901756 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-43b1d774-7877-4fa5-b7ff-564e60bc8d3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:30:03.967630 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-27d0c513-1fa0-41ca-9775-de7b49ffb910 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:03.968752 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-27d0c513-1fa0-41ca-9775-de7b49ffb910 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:03.974396 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27d0c513-1fa0-41ca-9775-de7b49ffb910 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:03.974886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27d0c513-1fa0-41ca-9775-de7b49ffb910 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:03.975385 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27d0c513-1fa0-41ca-9775-de7b49ffb910 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:03.976186 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27d0c513-1fa0-41ca-9775-de7b49ffb910 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:03.976750 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27d0c513-1fa0-41ca-9775-de7b49ffb910 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:03.976867 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-43b1d774-7877-4fa5-b7ff-564e60bc8d3c tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 204 len: 0 microversion: 2.1 time: 0.112198 Aug 05 02:30:03.977288 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-27d0c513-1fa0-41ca-9775-de7b49ffb910 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:03.977786 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 545/1088] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:30:03 2022] DELETE /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:03.986696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ef9965a9-41f9-4977-a863-e870d8578b5f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:03.987394 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ef9965a9-41f9-4977-a863-e870d8578b5f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:03.993693 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef9965a9-41f9-4977-a863-e870d8578b5f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:03.994901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef9965a9-41f9-4977-a863-e870d8578b5f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:03.995355 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef9965a9-41f9-4977-a863-e870d8578b5f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:03.996062 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef9965a9-41f9-4977-a863-e870d8578b5f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:03.996549 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef9965a9-41f9-4977-a863-e870d8578b5f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:03.996975 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef9965a9-41f9-4977-a863-e870d8578b5f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:04.116654 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-27d0c513-1fa0-41ca-9775-de7b49ffb910 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:04.125695 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-27d0c513-1fa0-41ca-9775-de7b49ffb910 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1319 microversion: 2.1 time: 0.161823 Aug 05 02:30:04.126500 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 544/1089] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:03 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:30:04.139356 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ef9965a9-41f9-4977-a863-e870d8578b5f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:04.146984 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ef9965a9-41f9-4977-a863-e870d8578b5f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1676 microversion: 2.1 time: 0.164228 Aug 05 02:30:04.147356 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 546/1090] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:03 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:30:05.147198 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-dcf1c9c6-34e0-4a4c-a1f9-1656ce804d84 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:05.147758 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-dcf1c9c6-34e0-4a4c-a1f9-1656ce804d84 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:05.154094 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dcf1c9c6-34e0-4a4c-a1f9-1656ce804d84 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:05.154565 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dcf1c9c6-34e0-4a4c-a1f9-1656ce804d84 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:05.154995 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dcf1c9c6-34e0-4a4c-a1f9-1656ce804d84 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:05.155675 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dcf1c9c6-34e0-4a4c-a1f9-1656ce804d84 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:05.156122 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dcf1c9c6-34e0-4a4c-a1f9-1656ce804d84 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:05.156564 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-dcf1c9c6-34e0-4a4c-a1f9-1656ce804d84 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:05.167370 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-944aa027-cc94-4077-8b79-f310995a713e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:05.167976 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-944aa027-cc94-4077-8b79-f310995a713e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:05.174330 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-944aa027-cc94-4077-8b79-f310995a713e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:05.174806 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-944aa027-cc94-4077-8b79-f310995a713e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:05.175355 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-944aa027-cc94-4077-8b79-f310995a713e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:05.176062 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-944aa027-cc94-4077-8b79-f310995a713e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:05.176538 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-944aa027-cc94-4077-8b79-f310995a713e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:05.176960 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-944aa027-cc94-4077-8b79-f310995a713e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:05.298989 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-dcf1c9c6-34e0-4a4c-a1f9-1656ce804d84 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:05.306488 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-dcf1c9c6-34e0-4a4c-a1f9-1656ce804d84 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1319 microversion: 2.1 time: 0.163252 Aug 05 02:30:05.307067 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 545/1091] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:05 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:05.319732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-944aa027-cc94-4077-8b79-f310995a713e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:05.329006 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-944aa027-cc94-4077-8b79-f310995a713e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1676 microversion: 2.1 time: 0.165328 Aug 05 02:30:05.329671 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 547/1092] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:05 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:30:06.227460 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-57542b26-7370-45c0-9543-a97537ab5090 req-f23fc1c6-9ed7-4dce-a97e-94fddd96f6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda05d94-80b5-4f53-b23d-2db4abf450ea", "name": "network-vif-plugged", "status": "completed", "tag": "2d8ac192-59d0-4717-855e-34a8aebbb09a"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:30:06.238398 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-57542b26-7370-45c0-9543-a97537ab5090 req-f23fc1c6-9ed7-4dce-a97e-94fddd96f6e4 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:06.238890 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-57542b26-7370-45c0-9543-a97537ab5090 req-f23fc1c6-9ed7-4dce-a97e-94fddd96f6e4 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:06.239315 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-57542b26-7370-45c0-9543-a97537ab5090 req-f23fc1c6-9ed7-4dce-a97e-94fddd96f6e4 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:06.251879 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-57542b26-7370-45c0-9543-a97537ab5090 req-f23fc1c6-9ed7-4dce-a97e-94fddd96f6e4 service nova] Creating event network-vif-plugged:2d8ac192-59d0-4717-855e-34a8aebbb09a for instance cda05d94-80b5-4f53-b23d-2db4abf450ea on hv-cinder-81558 Aug 05 02:30:06.256481 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-57542b26-7370-45c0-9543-a97537ab5090 req-f23fc1c6-9ed7-4dce-a97e-94fddd96f6e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032731 Aug 05 02:30:06.257248 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 546/1093] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:30:06.327168 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2a7e3591-484c-4801-9207-2a4080f8cce1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:06.327758 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2a7e3591-484c-4801-9207-2a4080f8cce1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:06.334230 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a7e3591-484c-4801-9207-2a4080f8cce1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:06.334716 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a7e3591-484c-4801-9207-2a4080f8cce1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:06.335155 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a7e3591-484c-4801-9207-2a4080f8cce1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:06.335848 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a7e3591-484c-4801-9207-2a4080f8cce1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:06.336303 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a7e3591-484c-4801-9207-2a4080f8cce1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:06.337013 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2a7e3591-484c-4801-9207-2a4080f8cce1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:06.353803 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f25c2fee-f842-4d66-aeae-b04d8503f76f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:06.355060 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f25c2fee-f842-4d66-aeae-b04d8503f76f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:06.361618 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f25c2fee-f842-4d66-aeae-b04d8503f76f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:06.362034 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f25c2fee-f842-4d66-aeae-b04d8503f76f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:06.362466 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f25c2fee-f842-4d66-aeae-b04d8503f76f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:06.363156 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f25c2fee-f842-4d66-aeae-b04d8503f76f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:06.363605 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f25c2fee-f842-4d66-aeae-b04d8503f76f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:06.364027 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f25c2fee-f842-4d66-aeae-b04d8503f76f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:06.478187 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2a7e3591-484c-4801-9207-2a4080f8cce1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:06.488490 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2a7e3591-484c-4801-9207-2a4080f8cce1 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1319 microversion: 2.1 time: 0.164973 Aug 05 02:30:06.489363 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 548/1094] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:06 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:06.640394 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f25c2fee-f842-4d66-aeae-b04d8503f76f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:06.647833 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f25c2fee-f842-4d66-aeae-b04d8503f76f tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1676 microversion: 2.1 time: 0.298361 Aug 05 02:30:06.648430 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 547/1095] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:06 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1676 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:30:07.371606 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-ba6e65f3-294b-4789-97ca-bad312dc4e47 req-5819d60f-ccc3-4b60-b7cd-7dfecf20fe17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a62bccf-ee14-4f75-ac75-78872dd510c8", "name": "network-vif-deleted", "tag": "632d332a-75d1-454b-bb98-b93cd5e86ca7"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:30:07.381299 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ba6e65f3-294b-4789-97ca-bad312dc4e47 req-5819d60f-ccc3-4b60-b7cd-7dfecf20fe17 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:07.381705 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ba6e65f3-294b-4789-97ca-bad312dc4e47 req-5819d60f-ccc3-4b60-b7cd-7dfecf20fe17 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:07.382135 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-ba6e65f3-294b-4789-97ca-bad312dc4e47 req-5819d60f-ccc3-4b60-b7cd-7dfecf20fe17 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:07.394189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-ba6e65f3-294b-4789-97ca-bad312dc4e47 req-5819d60f-ccc3-4b60-b7cd-7dfecf20fe17 service nova] Creating event network-vif-deleted:632d332a-75d1-454b-bb98-b93cd5e86ca7 for instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 on hv-cinder-81558 Aug 05 02:30:07.398995 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-ba6e65f3-294b-4789-97ca-bad312dc4e47 req-5819d60f-ccc3-4b60-b7cd-7dfecf20fe17 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031807 Aug 05 02:30:07.399570 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 549/1096] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:30:07.510492 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-06c1c6a6-c9a0-4000-ae3f-aaf03893ef17 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:07.511640 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-06c1c6a6-c9a0-4000-ae3f-aaf03893ef17 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:07.517963 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-06c1c6a6-c9a0-4000-ae3f-aaf03893ef17 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:07.519021 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-06c1c6a6-c9a0-4000-ae3f-aaf03893ef17 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:07.519649 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-06c1c6a6-c9a0-4000-ae3f-aaf03893ef17 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:07.520397 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-06c1c6a6-c9a0-4000-ae3f-aaf03893ef17 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:07.520855 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-06c1c6a6-c9a0-4000-ae3f-aaf03893ef17 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:07.521280 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-06c1c6a6-c9a0-4000-ae3f-aaf03893ef17 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:07.657362 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-06c1c6a6-c9a0-4000-ae3f-aaf03893ef17 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:07.665829 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-06c1c6a6-c9a0-4000-ae3f-aaf03893ef17 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1319 microversion: 2.1 time: 0.159332 Aug 05 02:30:07.666558 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 548/1097] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:07 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:07.670383 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2e8ef038-0351-4471-b5fd-c3c50c4dc91e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:07.671442 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2e8ef038-0351-4471-b5fd-c3c50c4dc91e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:07.677585 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e8ef038-0351-4471-b5fd-c3c50c4dc91e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:07.678076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e8ef038-0351-4471-b5fd-c3c50c4dc91e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:07.678516 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e8ef038-0351-4471-b5fd-c3c50c4dc91e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:07.679212 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e8ef038-0351-4471-b5fd-c3c50c4dc91e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:07.679856 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e8ef038-0351-4471-b5fd-c3c50c4dc91e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:07.680474 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e8ef038-0351-4471-b5fd-c3c50c4dc91e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:07.752381 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2e8ef038-0351-4471-b5fd-c3c50c4dc91e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:07.760485 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2e8ef038-0351-4471-b5fd-c3c50c4dc91e tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1608 microversion: 2.1 time: 0.095443 Aug 05 02:30:07.763206 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 550/1098] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:07 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1608 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:30:08.687681 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-442469ce-566d-4c3b-bc23-d266f3adc8cc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:08.688290 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-442469ce-566d-4c3b-bc23-d266f3adc8cc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:08.694674 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-442469ce-566d-4c3b-bc23-d266f3adc8cc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:08.695151 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-442469ce-566d-4c3b-bc23-d266f3adc8cc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:08.695582 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-442469ce-566d-4c3b-bc23-d266f3adc8cc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:08.696263 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-442469ce-566d-4c3b-bc23-d266f3adc8cc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:08.696739 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-442469ce-566d-4c3b-bc23-d266f3adc8cc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:08.697156 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-442469ce-566d-4c3b-bc23-d266f3adc8cc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:08.783252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e2e2a698-467b-4aba-8cef-f273f1a00135 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:08.783871 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e2e2a698-467b-4aba-8cef-f273f1a00135 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:08.790362 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e2a698-467b-4aba-8cef-f273f1a00135 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:08.790851 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e2a698-467b-4aba-8cef-f273f1a00135 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:08.791288 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e2a698-467b-4aba-8cef-f273f1a00135 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:08.792610 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e2a698-467b-4aba-8cef-f273f1a00135 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:08.793073 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e2a698-467b-4aba-8cef-f273f1a00135 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:08.793506 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e2a698-467b-4aba-8cef-f273f1a00135 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:08.825213 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e2a698-467b-4aba-8cef-f273f1a00135 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:08.825705 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e2a698-467b-4aba-8cef-f273f1a00135 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:08.826146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e2a698-467b-4aba-8cef-f273f1a00135 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:08.826597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-e2e2a698-467b-4aba-8cef-f273f1a00135 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lazy-loading 'fault' on Instance uuid 7a62bccf-ee14-4f75-ac75-78872dd510c8 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:30:08.836092 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-442469ce-566d-4c3b-bc23-d266f3adc8cc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:08.846879 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-442469ce-566d-4c3b-bc23-d266f3adc8cc tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1508 microversion: 2.1 time: 0.162966 Aug 05 02:30:08.847472 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 549/1099] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:08 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:08.867800 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d86a4494-8e03-40da-b631-2ae8400e5250 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f097caec-80ee-4d1b-97ac-1f5f87de7bd1", "device": "/dev/sdb"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:30:08.868829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e2e2a698-467b-4aba-8cef-f273f1a00135 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64280d0c3da14f329b6fc21228d92288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1ac0db26e648bba79191b3ad8a260b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:08.870432 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d86a4494-8e03-40da-b631-2ae8400e5250 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:08.871085 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:08.876794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d86a4494-8e03-40da-b631-2ae8400e5250 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:08.877345 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d86a4494-8e03-40da-b631-2ae8400e5250 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:08.877841 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d86a4494-8e03-40da-b631-2ae8400e5250 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:08.878189 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e2e2a698-467b-4aba-8cef-f273f1a00135 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 200 len: 1328 microversion: 2.1 time: 0.098952 Aug 05 02:30:08.878552 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d86a4494-8e03-40da-b631-2ae8400e5250 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:08.878749 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 551/1100] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:08 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:30:08.879013 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d86a4494-8e03-40da-b631-2ae8400e5250 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:08.879443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d86a4494-8e03-40da-b631-2ae8400e5250 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:09.130101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d86a4494-8e03-40da-b631-2ae8400e5250 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "POST /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265967 Aug 05 02:30:09.130749 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 550/1101] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Aug 5 02:30:08 2022] POST /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:30:09.899621 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eec1ee11-9ea4-46bb-8ad7-f8d876f14876 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:09.900213 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eec1ee11-9ea4-46bb-8ad7-f8d876f14876 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:09.908165 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eec1ee11-9ea4-46bb-8ad7-f8d876f14876 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:09.908688 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eec1ee11-9ea4-46bb-8ad7-f8d876f14876 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:09.909125 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eec1ee11-9ea4-46bb-8ad7-f8d876f14876 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:09.909812 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eec1ee11-9ea4-46bb-8ad7-f8d876f14876 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:09.910265 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eec1ee11-9ea4-46bb-8ad7-f8d876f14876 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:09.910801 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eec1ee11-9ea4-46bb-8ad7-f8d876f14876 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:09.926326 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-eec1ee11-9ea4-46bb-8ad7-f8d876f14876 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] HTTP exception thrown: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eec1ee11-9ea4-46bb-8ad7-f8d876f14876 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Request method failure captured: Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 HTTP/1.1 Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5s3hQ3kOD4WL2KLqkoL_gM9AiYc1ydK9E-n2GYq7YFgrz6PJ9tbrfP-t6_AeSzxJDNjui5X0ojaQfeWudUidxPRgNDn48WNDqh4Bx-R1lfWxWwF_LHW6lg4dlcfZwXEyzeThRS2pimTzks3HnbgIGQ9XyUWDhVrOsg2GKYQVE7QBw Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: ce1ac0db26e648bba79191b3ad8a260b Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:30:09.927958 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:30:09.929609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ce1ac0db26e648bba79191b3ad8a260b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ce1ac0db26e648bba79191b3ad8a260b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce1ac0db26e648bba79191b3ad8a260b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce1ac0db26e648bba79191b3ad8a260b"}]}] Aug 05 02:30:09.929609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:30:09.929609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: ce1ac0db26e648bba79191b3ad8a260b Aug 05 02:30:09.929609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:30:09.929609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-628550396-project Aug 05 02:30:09.929609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:30:09.929609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:30:09.929609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 64280d0c3da14f329b6fc21228d92288 Aug 05 02:30:09.929609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-628550396-project Aug 05 02:30:09.929609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:30:09.929609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. Aug 05 02:30:09.929609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '7a62bccf-ee14-4f75-ac75-78872dd510c8'} Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:30:09.930533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. Aug 05 02:30:09.932148 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:09.933602 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eec1ee11-9ea4-46bb-8ad7-f8d876f14876 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Returning 404 to user: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:30:09.933602 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eec1ee11-9ea4-46bb-8ad7-f8d876f14876 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 404 len: 111 microversion: 2.1 time: 0.034043 Aug 05 02:30:09.933602 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 552/1102] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:09 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:30:09.939629 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ea0e6a4f-11ff-455b-8e4c-7ab725f704a3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '.version_select at 0x7fa65e3ee9d0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:09.957881 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ea0e6a4f-11ff-455b-8e4c-7ab725f704a3 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094181975" status: 202 len: 0 microversion: 2.1 time: 0.022901 Aug 05 02:30:09.958424 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 551/1103] 10.222.0.15 () {58 vars in 1221 bytes} [Fri Aug 5 02:30:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094181975 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:30:12.852600 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-09548e8e-fae0-41a2-93dc-a23bef3b5be1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:12.853103 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-09548e8e-fae0-41a2-93dc-a23bef3b5be1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:12.860139 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09548e8e-fae0-41a2-93dc-a23bef3b5be1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:12.860666 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09548e8e-fae0-41a2-93dc-a23bef3b5be1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:12.861135 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09548e8e-fae0-41a2-93dc-a23bef3b5be1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:12.861823 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09548e8e-fae0-41a2-93dc-a23bef3b5be1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:12.862281 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09548e8e-fae0-41a2-93dc-a23bef3b5be1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:12.862711 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09548e8e-fae0-41a2-93dc-a23bef3b5be1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:12.876610 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-09548e8e-fae0-41a2-93dc-a23bef3b5be1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] HTTP exception thrown: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-09548e8e-fae0-41a2-93dc-a23bef3b5be1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Request method failure captured: Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 HTTP/1.1 Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5s3hQ3kOD4WL2KLqkoL_gM9AiYc1ydK9E-n2GYq7YFgrz6PJ9tbrfP-t6_AeSzxJDNjui5X0ojaQfeWudUidxPRgNDn48WNDqh4Bx-R1lfWxWwF_LHW6lg4dlcfZwXEyzeThRS2pimTzks3HnbgIGQ9XyUWDhVrOsg2GKYQVE7QBw Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: ce1ac0db26e648bba79191b3ad8a260b Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:30:12.878174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:30:12.879791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ce1ac0db26e648bba79191b3ad8a260b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ce1ac0db26e648bba79191b3ad8a260b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce1ac0db26e648bba79191b3ad8a260b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce1ac0db26e648bba79191b3ad8a260b"}]}] Aug 05 02:30:12.879791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:30:12.879791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: ce1ac0db26e648bba79191b3ad8a260b Aug 05 02:30:12.879791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:30:12.879791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-628550396-project Aug 05 02:30:12.879791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:30:12.879791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:30:12.879791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 64280d0c3da14f329b6fc21228d92288 Aug 05 02:30:12.879791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-628550396-project Aug 05 02:30:12.879791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:30:12.879791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. Aug 05 02:30:12.879791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '7a62bccf-ee14-4f75-ac75-78872dd510c8'} Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:30:12.880902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. Aug 05 02:30:12.882391 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:12.884001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-09548e8e-fae0-41a2-93dc-a23bef3b5be1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Returning 404 to user: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:30:12.884001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-09548e8e-fae0-41a2-93dc-a23bef3b5be1 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 404 len: 111 microversion: 2.1 time: 0.030885 Aug 05 02:30:12.884001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 553/1104] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:30:12 2022] DELETE /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:30:12.888842 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-580088c8-db63-41d9-8d82-ddc00092beb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:12.889571 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-580088c8-db63-41d9-8d82-ddc00092beb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: 7a62bccf-ee14-4f75-ac75-78872dd510c8] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:12.896248 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-580088c8-db63-41d9-8d82-ddc00092beb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:12.896760 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-580088c8-db63-41d9-8d82-ddc00092beb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:12.897262 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-580088c8-db63-41d9-8d82-ddc00092beb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:12.897948 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-580088c8-db63-41d9-8d82-ddc00092beb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:12.898402 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-580088c8-db63-41d9-8d82-ddc00092beb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:12.898827 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-580088c8-db63-41d9-8d82-ddc00092beb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:12.911911 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-580088c8-db63-41d9-8d82-ddc00092beb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] HTTP exception thrown: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-580088c8-db63-41d9-8d82-ddc00092beb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Request method failure captured: Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 HTTP/1.1 Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5s3hQ3kOD4WL2KLqkoL_gM9AiYc1ydK9E-n2GYq7YFgrz6PJ9tbrfP-t6_AeSzxJDNjui5X0ojaQfeWudUidxPRgNDn48WNDqh4Bx-R1lfWxWwF_LHW6lg4dlcfZwXEyzeThRS2pimTzks3HnbgIGQ9XyUWDhVrOsg2GKYQVE7QBw Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: ce1ac0db26e648bba79191b3ad8a260b Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:30:12.913536 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:30:12.915155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ce1ac0db26e648bba79191b3ad8a260b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ce1ac0db26e648bba79191b3ad8a260b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce1ac0db26e648bba79191b3ad8a260b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce1ac0db26e648bba79191b3ad8a260b"}]}] Aug 05 02:30:12.915155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:30:12.915155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: ce1ac0db26e648bba79191b3ad8a260b Aug 05 02:30:12.915155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:30:12.915155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeTestJSON-628550396-project Aug 05 02:30:12.915155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:30:12.915155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:30:12.915155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 64280d0c3da14f329b6fc21228d92288 Aug 05 02:30:12.915155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeTestJSON-628550396-project Aug 05 02:30:12.915155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:30:12.915155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. Aug 05 02:30:12.915155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': '7a62bccf-ee14-4f75-ac75-78872dd510c8'} Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:30:12.916210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. Aug 05 02:30:12.918298 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:12.919730 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-580088c8-db63-41d9-8d82-ddc00092beb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Returning 404 to user: Instance 7a62bccf-ee14-4f75-ac75-78872dd510c8 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:30:12.919730 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-580088c8-db63-41d9-8d82-ddc00092beb6 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8" status: 404 len: 111 microversion: 2.1 time: 0.030957 Aug 05 02:30:12.919730 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 552/1105] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:12 2022] GET /compute/v2.1/servers/7a62bccf-ee14-4f75-ac75-78872dd510c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:30:14.052886 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e84d5c6-f0e5-4a17-9129-029e6f9ad803 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:14.053395 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7e84d5c6-f0e5-4a17-9129-029e6f9ad803 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:14.060021 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e84d5c6-f0e5-4a17-9129-029e6f9ad803 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:14.060549 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e84d5c6-f0e5-4a17-9129-029e6f9ad803 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:14.060988 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e84d5c6-f0e5-4a17-9129-029e6f9ad803 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:14.061683 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e84d5c6-f0e5-4a17-9129-029e6f9ad803 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:14.062164 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e84d5c6-f0e5-4a17-9129-029e6f9ad803 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:14.062594 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e84d5c6-f0e5-4a17-9129-029e6f9ad803 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:14.076436 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-7e84d5c6-f0e5-4a17-9129-029e6f9ad803 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] HTTP exception thrown: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e84d5c6-f0e5-4a17-9129-029e6f9ad803 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Request method failure captured: Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 HTTP/1.1 Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5s3hQ3kOD4WL2KLqkoL_gM9AiYc1ydK9E-n2GYq7YFgrz6PJ9tbrfP-t6_AeSzxJDNjui5X0ojaQfeWudUidxPRgNDn48WNDqh4Bx-R1lfWxWwF_LHW6lg4dlcfZwXEyzeThRS2pimTzks3HnbgIGQ9XyUWDhVrOsg2GKYQVE7QBw Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: ce1ac0db26e648bba79191b3ad8a260b Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:30:14.077968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:30:14.079426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ce1ac0db26e648bba79191b3ad8a260b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ce1ac0db26e648bba79191b3ad8a260b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce1ac0db26e648bba79191b3ad8a260b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce1ac0db26e648bba79191b3ad8a260b"}]}] Aug 05 02:30:14.079426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:30:14.079426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: ce1ac0db26e648bba79191b3ad8a260b Aug 05 02:30:14.079426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:30:14.079426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-628550396-project Aug 05 02:30:14.079426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:30:14.079426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:30:14.079426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 64280d0c3da14f329b6fc21228d92288 Aug 05 02:30:14.079426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-628550396-project Aug 05 02:30:14.079426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:30:14.079426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. Aug 05 02:30:14.079426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': 'd325dc2e-780c-41fe-bdad-ac41805f3534'} Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:30:14.080357 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. Aug 05 02:30:14.082076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:14.083759 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e84d5c6-f0e5-4a17-9129-029e6f9ad803 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Returning 404 to user: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:30:14.083759 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7e84d5c6-f0e5-4a17-9129-029e6f9ad803 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 404 len: 111 microversion: 2.1 time: 0.030360 Aug 05 02:30:14.083759 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 554/1106] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:30:14 2022] DELETE /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:30:14.087900 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3e2674af-0fe6-4e02-a317-e8e6814f6235 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:14.088476 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3e2674af-0fe6-4e02-a317-e8e6814f6235 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] [instance: d325dc2e-780c-41fe-bdad-ac41805f3534] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:14.095476 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e2674af-0fe6-4e02-a317-e8e6814f6235 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:14.095948 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e2674af-0fe6-4e02-a317-e8e6814f6235 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:14.096409 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e2674af-0fe6-4e02-a317-e8e6814f6235 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:14.097087 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e2674af-0fe6-4e02-a317-e8e6814f6235 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:14.097530 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e2674af-0fe6-4e02-a317-e8e6814f6235 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:14.097944 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3e2674af-0fe6-4e02-a317-e8e6814f6235 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:14.111006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-3e2674af-0fe6-4e02-a317-e8e6814f6235 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] HTTP exception thrown: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3e2674af-0fe6-4e02-a317-e8e6814f6235 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Request method failure captured: Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 HTTP/1.1 Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5s3hQ3kOD4WL2KLqkoL_gM9AiYc1ydK9E-n2GYq7YFgrz6PJ9tbrfP-t6_AeSzxJDNjui5X0ojaQfeWudUidxPRgNDn48WNDqh4Bx-R1lfWxWwF_LHW6lg4dlcfZwXEyzeThRS2pimTzks3HnbgIGQ9XyUWDhVrOsg2GKYQVE7QBw Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: ce1ac0db26e648bba79191b3ad8a260b Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:30:14.112556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:30:14.114038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ce1ac0db26e648bba79191b3ad8a260b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ce1ac0db26e648bba79191b3ad8a260b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce1ac0db26e648bba79191b3ad8a260b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce1ac0db26e648bba79191b3ad8a260b"}]}] Aug 05 02:30:14.114038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:30:14.114038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: ce1ac0db26e648bba79191b3ad8a260b Aug 05 02:30:14.114038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeTestJSON-628550396 Aug 05 02:30:14.114038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeTestJSON-628550396-project Aug 05 02:30:14.114038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:30:14.114038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:30:14.114038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 64280d0c3da14f329b6fc21228d92288 Aug 05 02:30:14.114038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeTestJSON-628550396-project Aug 05 02:30:14.114038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:30:14.114038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. Aug 05 02:30:14.114038 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': 'd325dc2e-780c-41fe-bdad-ac41805f3534'} Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:30:14.114815 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. Aug 05 02:30:14.116022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:14.117167 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3e2674af-0fe6-4e02-a317-e8e6814f6235 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] Returning 404 to user: Instance d325dc2e-780c-41fe-bdad-ac41805f3534 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:30:14.117167 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3e2674af-0fe6-4e02-a317-e8e6814f6235 tempest-AttachVolumeTestJSON-628550396 tempest-AttachVolumeTestJSON-628550396-project] 10.222.0.15 "GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534" status: 404 len: 111 microversion: 2.1 time: 0.030129 Aug 05 02:30:14.117167 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 553/1107] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:14 2022] GET /compute/v2.1/servers/d325dc2e-780c-41fe-bdad-ac41805f3534 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:30:18.588120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6f9c5833-b868-4406-8dda-36eafebc57d0 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Action: 'create', calling method: .version_select at 0x7fa65c4f4670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-433073783", "metadata": {"Type": "work"}}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6f9c5833-b868-4406-8dda-36eafebc57d0 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Request method failure captured: Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 121 Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7IC68aZ8Yj88i9bovhHrrnGwNwGSU5aPVXOLW2enTvmYridnVugf1B4I7qLEn912ce53unXm07RSQJmb8jaBrxiJeHWnC_66vRVglYA9XtG28_5_KatfZxQ3J3FEYaTFji0wmVsbi5IILWYgYsnKS0TyPQ_johttfo-Gc9RVfuw2rlY Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 5caeb95074f34054855d423c92ae0ee4 Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:30:18.604915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:30:18.606553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5caeb95074f34054855d423c92ae0ee4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5caeb95074f34054855d423c92ae0ee4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5caeb95074f34054855d423c92ae0ee4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5caeb95074f34054855d423c92ae0ee4"}]}] Aug 05 02:30:18.606553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.606553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 5caeb95074f34054855d423c92ae0ee4 Aug 05 02:30:18.606553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.606553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-1178931753-project Aug 05 02:30:18.606553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:30:18.606553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:30:18.606553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: cd1e8ed6f9c3423786367cc5809bb555 Aug 05 02:30:18.606553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-1178931753-project Aug 05 02:30:18.606553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Aug 05 02:30:18.606553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-433073783", "metadata": {"Type": "work"}}} Aug 05 02:30:18.606553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: Aug 05 02:30:18.606553 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-433073783', 'metadata': {'Type': 'work'}}}} Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise error Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi '#$%' Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:30:18.607527 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 02:30:18.608966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 02:30:18.610138 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 05 02:30:18.610138 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.610138 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6f9c5833-b868-4406-8dda-36eafebc57d0 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:30:18.610138 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6f9c5833-b868-4406-8dda-36eafebc57d0 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.129869 Aug 05 02:30:18.610138 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 555/1108] 10.222.0.15 () {60 vars in 1156 bytes} [Fri Aug 5 02:30:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 05 02:30:18.615707 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cb01925c-19e6-46eb-a8da-40a55c4934f7 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Action: 'create', calling method: .version_select at 0x7fa65e3ee700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-849056526", "metadata": {"Type": "work"}}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cb01925c-19e6-46eb-a8da-40a55c4934f7 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Request method failure captured: Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 119 Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7IC68aZ8Yj88i9bovhHrrnGwNwGSU5aPVXOLW2enTvmYridnVugf1B4I7qLEn912ce53unXm07RSQJmb8jaBrxiJeHWnC_66vRVglYA9XtG28_5_KatfZxQ3J3FEYaTFji0wmVsbi5IILWYgYsnKS0TyPQ_johttfo-Gc9RVfuw2rlY Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: 5caeb95074f34054855d423c92ae0ee4 Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:30:18.621155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:30:18.622973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5caeb95074f34054855d423c92ae0ee4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5caeb95074f34054855d423c92ae0ee4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5caeb95074f34054855d423c92ae0ee4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5caeb95074f34054855d423c92ae0ee4"}]}] Aug 05 02:30:18.622973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.622973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 5caeb95074f34054855d423c92ae0ee4 Aug 05 02:30:18.622973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.622973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesNegativeTest-1178931753-project Aug 05 02:30:18.622973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:30:18.622973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:30:18.622973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: cd1e8ed6f9c3423786367cc5809bb555 Aug 05 02:30:18.622973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesNegativeTest-1178931753-project Aug 05 02:30:18.622973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Aug 05 02:30:18.622973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-849056526", "metadata": {"Type": "work"}}} Aug 05 02:30:18.622973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: Aug 05 02:30:18.622973 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-849056526', 'metadata': {'Type': 'work'}}}} Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise error Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi '0' Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:30:18.623796 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 02:30:18.625299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 02:30:18.626690 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 05 02:30:18.626690 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.626690 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-cb01925c-19e6-46eb-a8da-40a55c4934f7 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:30:18.626690 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-cb01925c-19e6-46eb-a8da-40a55c4934f7 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010264 Aug 05 02:30:18.626690 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 554/1109] 10.222.0.15 () {60 vars in 1156 bytes} [Fri Aug 5 02:30:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 02:30:18.632927 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b2f2c80d-78a8-43d7-a12e-ec99eeb61a0e tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Action: 'create', calling method: .version_select at 0x7fa65c7a5790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2039526673", "metadata": {"Type": "work"}}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b2f2c80d-78a8-43d7-a12e-ec99eeb61a0e tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Request method failure captured: Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 119 Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7IC68aZ8Yj88i9bovhHrrnGwNwGSU5aPVXOLW2enTvmYridnVugf1B4I7qLEn912ce53unXm07RSQJmb8jaBrxiJeHWnC_66vRVglYA9XtG28_5_KatfZxQ3J3FEYaTFji0wmVsbi5IILWYgYsnKS0TyPQ_johttfo-Gc9RVfuw2rlY Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 5caeb95074f34054855d423c92ae0ee4 Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:30:18.637660 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:30:18.639270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5caeb95074f34054855d423c92ae0ee4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5caeb95074f34054855d423c92ae0ee4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5caeb95074f34054855d423c92ae0ee4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5caeb95074f34054855d423c92ae0ee4"}]}] Aug 05 02:30:18.639270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.639270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 5caeb95074f34054855d423c92ae0ee4 Aug 05 02:30:18.639270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.639270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-1178931753-project Aug 05 02:30:18.639270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:30:18.639270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:30:18.639270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: cd1e8ed6f9c3423786367cc5809bb555 Aug 05 02:30:18.639270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-1178931753-project Aug 05 02:30:18.639270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Aug 05 02:30:18.639270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2039526673", "metadata": {"Type": "work"}}} Aug 05 02:30:18.639270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: Aug 05 02:30:18.639270 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2039526673', 'metadata': {'Type': 'work'}}}} Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise error Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi '' Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:30:18.640306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 05 02:30:18.641949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 05 02:30:18.643473 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 05 02:30:18.643473 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.643473 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b2f2c80d-78a8-43d7-a12e-ec99eeb61a0e tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:30:18.643473 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b2f2c80d-78a8-43d7-a12e-ec99eeb61a0e tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010917 Aug 05 02:30:18.643473 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 556/1110] 10.222.0.15 () {60 vars in 1156 bytes} [Fri Aug 5 02:30:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 05 02:30:18.648470 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9958672d-84ef-484d-8468-7ed42cb0fd38 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Calling method '.version_select at 0x7fa65c5b6430>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:18.796676 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-9958672d-84ef-484d-8468-7ed42cb0fd38 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] HTTP exception thrown: Volume tempest-invalid-1236471461 could not be found. Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9958672d-84ef-484d-8468-7ed42cb0fd38 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Request method failure captured: Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1236471461 HTTP/1.1 Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7IC68aZ8Yj88i9bovhHrrnGwNwGSU5aPVXOLW2enTvmYridnVugf1B4I7qLEn912ce53unXm07RSQJmb8jaBrxiJeHWnC_66vRVglYA9XtG28_5_KatfZxQ3J3FEYaTFji0wmVsbi5IILWYgYsnKS0TyPQ_johttfo-Gc9RVfuw2rlY Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: 5caeb95074f34054855d423c92ae0ee4 Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:30:18.798621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:30:18.800251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5caeb95074f34054855d423c92ae0ee4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5caeb95074f34054855d423c92ae0ee4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5caeb95074f34054855d423c92ae0ee4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5caeb95074f34054855d423c92ae0ee4"}]}] Aug 05 02:30:18.800251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.800251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 5caeb95074f34054855d423c92ae0ee4 Aug 05 02:30:18.800251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.800251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesNegativeTest-1178931753-project Aug 05 02:30:18.800251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:30:18.800251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:30:18.800251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: cd1e8ed6f9c3423786367cc5809bb555 Aug 05 02:30:18.800251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesNegativeTest-1178931753-project Aug 05 02:30:18.800251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: Aug 05 02:30:18.800251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Volume tempest-invalid-1236471461 could not be found. Aug 05 02:30:18.800251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': 'tempest-invalid-1236471461'} Aug 05 02:30:18.800251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1236471461 could not be found. (HTTP 404) (Request-ID: req-bc891b76-ff4c-48c8-b373-effa8b2c026f) Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:18.801173 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 02:30:18.802443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1236471461 could not be found. Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:30:18.803621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1236471461 could not be found. Aug 05 02:30:18.805073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.805073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:18.805073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.805073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.805073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:18.805073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:18.805073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:30:18.805073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:30:18.805073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1236471461 could not be found. Aug 05 02:30:18.805073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.805073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9958672d-84ef-484d-8468-7ed42cb0fd38 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Returning 404 to user: Volume tempest-invalid-1236471461 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:30:18.805073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9958672d-84ef-484d-8468-7ed42cb0fd38 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1236471461" status: 404 len: 99 microversion: 2.1 time: 0.155880 Aug 05 02:30:18.805073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 555/1111] 10.222.0.15 () {58 vars in 1218 bytes} [Fri Aug 5 02:30:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1236471461 => generated 99 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 05 02:30:18.809943 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b1b77ca1-fa7e-409a-99f7-84c5b98d5d01 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004160 Aug 05 02:30:18.810426 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 557/1112] 10.222.0.15 () {58 vars in 1140 bytes} [Fri Aug 5 02:30:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 02:30:18.818543 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-7835a182-e23e-4234-9c88-e8b321f8ab57 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003799 Aug 05 02:30:18.819028 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 556/1113] 10.222.0.15 () {58 vars in 1137 bytes} [Fri Aug 5 02:30:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 05 02:30:18.828006 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3e1a9c2d-5506-42bd-a321-0ccf09192c83 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Calling method '.version_select at 0x7fa65c4f4ca0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:18.911544 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-3e1a9c2d-5506-42bd-a321-0ccf09192c83 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] HTTP exception thrown: Volume 60afd5de-f479-424d-83e5-8ae9a7166da3 could not be found. Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3e1a9c2d-5506-42bd-a321-0ccf09192c83 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Request method failure captured: Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/os-volumes/60afd5de-f479-424d-83e5-8ae9a7166da3 HTTP/1.1 Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7IC68aZ8Yj88i9bovhHrrnGwNwGSU5aPVXOLW2enTvmYridnVugf1B4I7qLEn912ce53unXm07RSQJmb8jaBrxiJeHWnC_66vRVglYA9XtG28_5_KatfZxQ3J3FEYaTFji0wmVsbi5IILWYgYsnKS0TyPQ_johttfo-Gc9RVfuw2rlY Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 5caeb95074f34054855d423c92ae0ee4 Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:30:18.921434 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:30:18.922852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5caeb95074f34054855d423c92ae0ee4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5caeb95074f34054855d423c92ae0ee4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5caeb95074f34054855d423c92ae0ee4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5caeb95074f34054855d423c92ae0ee4"}]}] Aug 05 02:30:18.922852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.922852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 5caeb95074f34054855d423c92ae0ee4 Aug 05 02:30:18.922852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.922852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-1178931753-project Aug 05 02:30:18.922852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:30:18.922852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:30:18.922852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: cd1e8ed6f9c3423786367cc5809bb555 Aug 05 02:30:18.922852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-1178931753-project Aug 05 02:30:18.922852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: Aug 05 02:30:18.922852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Volume 60afd5de-f479-424d-83e5-8ae9a7166da3 could not be found. Aug 05 02:30:18.922852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '60afd5de-f479-424d-83e5-8ae9a7166da3'} Aug 05 02:30:18.922852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60afd5de-f479-424d-83e5-8ae9a7166da3 could not be found. (HTTP 404) (Request-ID: req-26eca67e-a1ee-4bc9-a4bc-f28e673db234) Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:18.923724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 02:30:18.925001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60afd5de-f479-424d-83e5-8ae9a7166da3 could not be found. Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 02:30:18.926224 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:30:18.927634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60afd5de-f479-424d-83e5-8ae9a7166da3 could not be found. Aug 05 02:30:18.927634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.927634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:18.927634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.927634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.927634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:18.927634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:18.927634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:30:18.927634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:30:18.927634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60afd5de-f479-424d-83e5-8ae9a7166da3 could not be found. Aug 05 02:30:18.927634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.927634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3e1a9c2d-5506-42bd-a321-0ccf09192c83 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Returning 404 to user: Volume 60afd5de-f479-424d-83e5-8ae9a7166da3 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:30:18.927634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3e1a9c2d-5506-42bd-a321-0ccf09192c83 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/60afd5de-f479-424d-83e5-8ae9a7166da3" status: 404 len: 109 microversion: 2.1 time: 0.098435 Aug 05 02:30:18.927634 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 558/1114] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Aug 5 02:30:18 2022] DELETE /compute/v2.1/os-volumes/60afd5de-f479-424d-83e5-8ae9a7166da3 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 02:30:18.932955 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-58a445f5-a052-47f4-9424-27e0759ca454 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Calling method '.version_select at 0x7fa65c89e700>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:18.960282 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-58a445f5-a052-47f4-9424-27e0759ca454 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] HTTP exception thrown: Volume b7d701e6-3fa0-4289-96c9-66d4cd8d2a22 could not be found. Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-58a445f5-a052-47f4-9424-27e0759ca454 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Request method failure captured: Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/os-volumes/b7d701e6-3fa0-4289-96c9-66d4cd8d2a22 HTTP/1.1 Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7IC68aZ8Yj88i9bovhHrrnGwNwGSU5aPVXOLW2enTvmYridnVugf1B4I7qLEn912ce53unXm07RSQJmb8jaBrxiJeHWnC_66vRVglYA9XtG28_5_KatfZxQ3J3FEYaTFji0wmVsbi5IILWYgYsnKS0TyPQ_johttfo-Gc9RVfuw2rlY Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: 5caeb95074f34054855d423c92ae0ee4 Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:30:18.962521 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:30:18.964687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5caeb95074f34054855d423c92ae0ee4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5caeb95074f34054855d423c92ae0ee4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5caeb95074f34054855d423c92ae0ee4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5caeb95074f34054855d423c92ae0ee4"}]}] Aug 05 02:30:18.964687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.964687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 5caeb95074f34054855d423c92ae0ee4 Aug 05 02:30:18.964687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesNegativeTest-1178931753 Aug 05 02:30:18.964687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesNegativeTest-1178931753-project Aug 05 02:30:18.964687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:30:18.964687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:30:18.964687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: cd1e8ed6f9c3423786367cc5809bb555 Aug 05 02:30:18.964687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesNegativeTest-1178931753-project Aug 05 02:30:18.964687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: Aug 05 02:30:18.964687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Volume b7d701e6-3fa0-4289-96c9-66d4cd8d2a22 could not be found. Aug 05 02:30:18.964687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': 'b7d701e6-3fa0-4289-96c9-66d4cd8d2a22'} Aug 05 02:30:18.964687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7d701e6-3fa0-4289-96c9-66d4cd8d2a22 could not be found. (HTTP 404) (Request-ID: req-944d6b02-f7fe-435a-b40a-ce785217aaf2) Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:18.965511 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 02:30:18.966662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7d701e6-3fa0-4289-96c9-66d4cd8d2a22 could not be found. Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 02:30:18.967783 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:30:18.968996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7d701e6-3fa0-4289-96c9-66d4cd8d2a22 could not be found. Aug 05 02:30:18.968996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.968996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:18.968996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.968996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:18.968996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:18.968996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:18.968996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:30:18.968996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:30:18.968996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7d701e6-3fa0-4289-96c9-66d4cd8d2a22 could not be found. Aug 05 02:30:18.968996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:30:18.968996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-58a445f5-a052-47f4-9424-27e0759ca454 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] Returning 404 to user: Volume b7d701e6-3fa0-4289-96c9-66d4cd8d2a22 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:30:18.968996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-58a445f5-a052-47f4-9424-27e0759ca454 tempest-VolumesNegativeTest-1178931753 tempest-VolumesNegativeTest-1178931753-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/b7d701e6-3fa0-4289-96c9-66d4cd8d2a22" status: 404 len: 109 microversion: 2.1 time: 0.034899 Aug 05 02:30:18.968996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 557/1115] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Aug 5 02:30:18 2022] GET /compute/v2.1/os-volumes/b7d701e6-3fa0-4289-96c9-66d4cd8d2a22 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 05 02:30:35.775049 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:35.778543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=7 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:35.782988 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3a62b421-6e24-419e-a49b-20695558a809 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:35.783478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3a62b421-6e24-419e-a49b-20695558a809 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:35.790649 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a62b421-6e24-419e-a49b-20695558a809 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:35.791134 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a62b421-6e24-419e-a49b-20695558a809 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:35.791571 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a62b421-6e24-419e-a49b-20695558a809 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:35.792263 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a62b421-6e24-419e-a49b-20695558a809 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:35.792744 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a62b421-6e24-419e-a49b-20695558a809 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:35.793168 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3a62b421-6e24-419e-a49b-20695558a809 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:35.872374 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-3a62b421-6e24-419e-a49b-20695558a809 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lazy-loading 'services' on Instance uuid cda05d94-80b5-4f53-b23d-2db4abf450ea {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:30:35.944009 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3a62b421-6e24-419e-a49b-20695558a809 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "DELETE /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea/os-volume_attachments/f097caec-80ee-4d1b-97ac-1f5f87de7bd1" status: 202 len: 0 microversion: 2.1 time: 0.170175 Aug 05 02:30:35.944626 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 559/1116] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Aug 5 02:30:35 2022] DELETE /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea/os-volume_attachments/f097caec-80ee-4d1b-97ac-1f5f87de7bd1 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:30:38.801831 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:30:38.802432 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Fri Aug 5 02:30:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:30:41.281609 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:41.282293 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:41.286493 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6605ccf5-1cdc-4342-80bc-ae36b5d81513 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:41.286979 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6605ccf5-1cdc-4342-80bc-ae36b5d81513 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:41.294278 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6605ccf5-1cdc-4342-80bc-ae36b5d81513 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:41.294762 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6605ccf5-1cdc-4342-80bc-ae36b5d81513 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:41.295955 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6605ccf5-1cdc-4342-80bc-ae36b5d81513 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:41.296852 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6605ccf5-1cdc-4342-80bc-ae36b5d81513 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:41.297312 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6605ccf5-1cdc-4342-80bc-ae36b5d81513 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:41.297846 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6605ccf5-1cdc-4342-80bc-ae36b5d81513 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:41.325755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6605ccf5-1cdc-4342-80bc-ae36b5d81513 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:30:41.397021 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6605ccf5-1cdc-4342-80bc-ae36b5d81513 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "DELETE /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 204 len: 0 microversion: 2.1 time: 0.116463 Aug 05 02:30:41.397590 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 558/1117] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:30:41 2022] DELETE /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:30:41.409272 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ea621ce3-d683-451a-905a-ac94db597418 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:41.410578 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ea621ce3-d683-451a-905a-ac94db597418 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:41.416858 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea621ce3-d683-451a-905a-ac94db597418 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:41.417363 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea621ce3-d683-451a-905a-ac94db597418 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:41.417795 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea621ce3-d683-451a-905a-ac94db597418 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:41.418488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea621ce3-d683-451a-905a-ac94db597418 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:41.418940 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea621ce3-d683-451a-905a-ac94db597418 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:41.419362 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea621ce3-d683-451a-905a-ac94db597418 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:41.548206 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ea621ce3-d683-451a-905a-ac94db597418 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:41.555696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ea621ce3-d683-451a-905a-ac94db597418 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1514 microversion: 2.1 time: 0.153225 Aug 05 02:30:41.556257 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 560/1118] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:41 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:42.578211 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-30c11296-20fc-43cd-8a7d-f19c232de893 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:42.578834 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-30c11296-20fc-43cd-8a7d-f19c232de893 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:42.591434 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-30c11296-20fc-43cd-8a7d-f19c232de893 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:42.592545 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-30c11296-20fc-43cd-8a7d-f19c232de893 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:42.593153 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-30c11296-20fc-43cd-8a7d-f19c232de893 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:42.593845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-30c11296-20fc-43cd-8a7d-f19c232de893 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:42.594292 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-30c11296-20fc-43cd-8a7d-f19c232de893 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:42.594708 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-30c11296-20fc-43cd-8a7d-f19c232de893 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:42.728553 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-30c11296-20fc-43cd-8a7d-f19c232de893 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:42.736026 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-30c11296-20fc-43cd-8a7d-f19c232de893 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1514 microversion: 2.1 time: 0.162875 Aug 05 02:30:42.736614 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 559/1119] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:42 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:43.758192 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ce2ec0e9-2d89-4ab8-bd68-b97226f78d1c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:43.760239 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ce2ec0e9-2d89-4ab8-bd68-b97226f78d1c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:43.767530 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce2ec0e9-2d89-4ab8-bd68-b97226f78d1c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:43.768009 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce2ec0e9-2d89-4ab8-bd68-b97226f78d1c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:43.768470 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce2ec0e9-2d89-4ab8-bd68-b97226f78d1c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:43.769173 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce2ec0e9-2d89-4ab8-bd68-b97226f78d1c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:43.769617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce2ec0e9-2d89-4ab8-bd68-b97226f78d1c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:43.770038 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce2ec0e9-2d89-4ab8-bd68-b97226f78d1c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:43.936109 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ce2ec0e9-2d89-4ab8-bd68-b97226f78d1c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4c0ebf69394f49abfb31e297dafccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeb435284914740b100d506c74bad6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:30:43.955787 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ce2ec0e9-2d89-4ab8-bd68-b97226f78d1c tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 200 len: 1514 microversion: 2.1 time: 0.201333 Aug 05 02:30:43.957881 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 561/1120] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:43 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:30:44.132180 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-7de595a2-412b-48ca-9ecd-f2ff2d02f50d req-f5a89cbe-6cd5-4cf7-9a54-5bc6a3abe7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda05d94-80b5-4f53-b23d-2db4abf450ea", "name": "network-vif-deleted", "tag": "2d8ac192-59d0-4717-855e-34a8aebbb09a"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:30:44.146300 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-7de595a2-412b-48ca-9ecd-f2ff2d02f50d req-f5a89cbe-6cd5-4cf7-9a54-5bc6a3abe7da service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:44.146803 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-7de595a2-412b-48ca-9ecd-f2ff2d02f50d req-f5a89cbe-6cd5-4cf7-9a54-5bc6a3abe7da service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:44.147452 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-7de595a2-412b-48ca-9ecd-f2ff2d02f50d req-f5a89cbe-6cd5-4cf7-9a54-5bc6a3abe7da service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:44.170490 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-7de595a2-412b-48ca-9ecd-f2ff2d02f50d req-f5a89cbe-6cd5-4cf7-9a54-5bc6a3abe7da service nova] Creating event network-vif-deleted:2d8ac192-59d0-4717-855e-34a8aebbb09a for instance cda05d94-80b5-4f53-b23d-2db4abf450ea on hv-cinder-81558 Aug 05 02:30:44.177632 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-7de595a2-412b-48ca-9ecd-f2ff2d02f50d req-f5a89cbe-6cd5-4cf7-9a54-5bc6a3abe7da service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048106 Aug 05 02:30:44.178448 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 560/1121] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:30:44.978396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-418ce1ed-597a-4ff9-8228-16f3b86e6ce3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:30:44.979001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-418ce1ed-597a-4ff9-8228-16f3b86e6ce3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] [instance: cda05d94-80b5-4f53-b23d-2db4abf450ea] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:30:44.986383 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-418ce1ed-597a-4ff9-8228-16f3b86e6ce3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:44.986860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-418ce1ed-597a-4ff9-8228-16f3b86e6ce3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:44.987291 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-418ce1ed-597a-4ff9-8228-16f3b86e6ce3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:44.987983 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-418ce1ed-597a-4ff9-8228-16f3b86e6ce3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:30:44.988602 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-418ce1ed-597a-4ff9-8228-16f3b86e6ce3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:30:44.989283 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-418ce1ed-597a-4ff9-8228-16f3b86e6ce3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:30:45.008832 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-418ce1ed-597a-4ff9-8228-16f3b86e6ce3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] HTTP exception thrown: Instance cda05d94-80b5-4f53-b23d-2db4abf450ea could not be found. Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-418ce1ed-597a-4ff9-8228-16f3b86e6ce3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Request method failure captured: Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea HTTP/1.1 Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7IBAO14zDWMAhHWtQJOeQs0Ja-cpMaAPsrx2Tu_JUBAWAmm0fB8RP8HrWH0FREDnIUVrrm73a5BjxISehcdYqjyljxlGPWP030jy2C2arU7Qm8_OHmFJlptvrzndzVSXXngmYgMO8L_wLF1tLle_ujlUEzB_R4VW_uE9jYgKWGf-5ZU Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 8aeb435284914740b100d506c74bad6b Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1364126693 Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:30:45.010495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:30:45.011926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/8aeb435284914740b100d506c74bad6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_8aeb435284914740b100d506c74bad6b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8aeb435284914740b100d506c74bad6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/8aeb435284914740b100d506c74bad6b"}]}] Aug 05 02:30:45.011926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesSnapshotTestJSON-1364126693 Aug 05 02:30:45.011926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 8aeb435284914740b100d506c74bad6b Aug 05 02:30:45.011926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1364126693 Aug 05 02:30:45.011926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesSnapshotTestJSON-1364126693-project Aug 05 02:30:45.011926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:30:45.011926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:30:45.011926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: bf4c0ebf69394f49abfb31e297dafccf Aug 05 02:30:45.011926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesSnapshotTestJSON-1364126693-project Aug 05 02:30:45.011926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:30:45.011926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance cda05d94-80b5-4f53-b23d-2db4abf450ea could not be found. Aug 05 02:30:45.011926 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': 'cda05d94-80b5-4f53-b23d-2db4abf450ea'} Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cda05d94-80b5-4f53-b23d-2db4abf450ea could not be found. Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:30:45.012829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cda05d94-80b5-4f53-b23d-2db4abf450ea could not be found. Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cda05d94-80b5-4f53-b23d-2db4abf450ea could not be found. Aug 05 02:30:45.014245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:30:45.015441 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-418ce1ed-597a-4ff9-8228-16f3b86e6ce3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] Returning 404 to user: Instance cda05d94-80b5-4f53-b23d-2db4abf450ea could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:30:45.015441 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-418ce1ed-597a-4ff9-8228-16f3b86e6ce3 tempest-VolumesSnapshotTestJSON-1364126693 tempest-VolumesSnapshotTestJSON-1364126693-project] 10.222.0.15 "GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea" status: 404 len: 111 microversion: 2.1 time: 0.037498 Aug 05 02:30:45.015441 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 562/1122] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:30:44 2022] GET /compute/v2.1/servers/cda05d94-80b5-4f53-b23d-2db4abf450ea => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:31:06.470970 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:06.471705 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:06.475861 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6f3b3e9d-7b41-42cf-baf3-a2b3e4b7869f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:31:06.476506 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6f3b3e9d-7b41-42cf-baf3-a2b3e4b7869f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:06.484773 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f3b3e9d-7b41-42cf-baf3-a2b3e4b7869f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:06.485254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f3b3e9d-7b41-42cf-baf3-a2b3e4b7869f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:06.485744 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f3b3e9d-7b41-42cf-baf3-a2b3e4b7869f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:06.486376 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f3b3e9d-7b41-42cf-baf3-a2b3e4b7869f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:06.486834 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f3b3e9d-7b41-42cf-baf3-a2b3e4b7869f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:06.487255 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6f3b3e9d-7b41-42cf-baf3-a2b3e4b7869f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:06.511947 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-6f3b3e9d-7b41-42cf-baf3-a2b3e4b7869f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lazy-loading 'flavor' on Instance uuid 5eb56ea7-8771-41b9-b537-a6d4afeda7ab {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:31:06.583332 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6f3b3e9d-7b41-42cf-baf3-a2b3e4b7869f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "POST /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab/action" status: 202 len: 0 microversion: 2.1 time: 0.113664 Aug 05 02:31:06.583828 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 561/1123] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Aug 5 02:31:06 2022] POST /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:31:06.592526 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-83eb5582-0478-4cc2-ab00-a0a90fce6630 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:06.593961 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-83eb5582-0478-4cc2-ab00-a0a90fce6630 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:06.596084 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=8 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:06.596881 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:06.603772 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83eb5582-0478-4cc2-ab00-a0a90fce6630 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:06.604356 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83eb5582-0478-4cc2-ab00-a0a90fce6630 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:06.604817 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83eb5582-0478-4cc2-ab00-a0a90fce6630 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:06.605588 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83eb5582-0478-4cc2-ab00-a0a90fce6630 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:06.606058 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83eb5582-0478-4cc2-ab00-a0a90fce6630 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:06.606484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83eb5582-0478-4cc2-ab00-a0a90fce6630 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:06.743535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-83eb5582-0478-4cc2-ab00-a0a90fce6630 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:06.751138 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-83eb5582-0478-4cc2-ab00-a0a90fce6630 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.162581 Aug 05 02:31:06.751686 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 563/1124] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:06 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:07.773917 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-349b79bf-f192-45ea-b833-704340989d67 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:07.774613 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-349b79bf-f192-45ea-b833-704340989d67 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:07.781106 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-349b79bf-f192-45ea-b833-704340989d67 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:07.781588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-349b79bf-f192-45ea-b833-704340989d67 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:07.782022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-349b79bf-f192-45ea-b833-704340989d67 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:07.782743 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-349b79bf-f192-45ea-b833-704340989d67 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:07.783540 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-349b79bf-f192-45ea-b833-704340989d67 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:07.783983 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-349b79bf-f192-45ea-b833-704340989d67 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:07.926430 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-349b79bf-f192-45ea-b833-704340989d67 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:07.933722 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-349b79bf-f192-45ea-b833-704340989d67 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.164701 Aug 05 02:31:07.934278 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 562/1125] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:07 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:08.955733 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4650c3e2-6346-44fc-8744-bfb91ac33dcc tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:08.956363 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4650c3e2-6346-44fc-8744-bfb91ac33dcc tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:08.963171 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4650c3e2-6346-44fc-8744-bfb91ac33dcc tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:08.963650 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4650c3e2-6346-44fc-8744-bfb91ac33dcc tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:08.964088 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4650c3e2-6346-44fc-8744-bfb91ac33dcc tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:08.964813 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4650c3e2-6346-44fc-8744-bfb91ac33dcc tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:08.965268 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4650c3e2-6346-44fc-8744-bfb91ac33dcc tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:08.965696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4650c3e2-6346-44fc-8744-bfb91ac33dcc tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:09.097257 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4650c3e2-6346-44fc-8744-bfb91ac33dcc tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:09.104617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4650c3e2-6346-44fc-8744-bfb91ac33dcc tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.153349 Aug 05 02:31:09.105192 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 564/1126] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:08 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:09.203858 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-93238333-d5da-4da8-845e-98edbf8ca8d3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:09.204441 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-93238333-d5da-4da8-845e-98edbf8ca8d3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:09.210867 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93238333-d5da-4da8-845e-98edbf8ca8d3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:09.211287 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93238333-d5da-4da8-845e-98edbf8ca8d3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:09.211737 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93238333-d5da-4da8-845e-98edbf8ca8d3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:09.212698 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93238333-d5da-4da8-845e-98edbf8ca8d3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:09.213144 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93238333-d5da-4da8-845e-98edbf8ca8d3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:09.213559 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-93238333-d5da-4da8-845e-98edbf8ca8d3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:09.237020 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-93238333-d5da-4da8-845e-98edbf8ca8d3 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a/ips" status: 200 len: 150 microversion: 2.1 time: 0.037234 Aug 05 02:31:09.237571 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 563/1127] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Aug 5 02:31:09 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:31:10.126422 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-77f257b1-9391-4ce3-a39f-e380bb922318 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:10.126972 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-77f257b1-9391-4ce3-a39f-e380bb922318 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:10.133433 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77f257b1-9391-4ce3-a39f-e380bb922318 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:10.133919 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77f257b1-9391-4ce3-a39f-e380bb922318 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:10.134362 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77f257b1-9391-4ce3-a39f-e380bb922318 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:10.135061 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77f257b1-9391-4ce3-a39f-e380bb922318 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:10.135518 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77f257b1-9391-4ce3-a39f-e380bb922318 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:10.135956 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-77f257b1-9391-4ce3-a39f-e380bb922318 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:10.278235 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-77f257b1-9391-4ce3-a39f-e380bb922318 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:10.285820 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-77f257b1-9391-4ce3-a39f-e380bb922318 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.163475 Aug 05 02:31:10.291609 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 565/1128] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:10 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:11.306598 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-524dcc16-b520-43bb-b14e-1e5c55185d86 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:11.307201 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-524dcc16-b520-43bb-b14e-1e5c55185d86 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:11.314044 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-524dcc16-b520-43bb-b14e-1e5c55185d86 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:11.314516 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-524dcc16-b520-43bb-b14e-1e5c55185d86 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:11.314941 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-524dcc16-b520-43bb-b14e-1e5c55185d86 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:11.315615 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-524dcc16-b520-43bb-b14e-1e5c55185d86 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:11.316062 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-524dcc16-b520-43bb-b14e-1e5c55185d86 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:11.316506 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-524dcc16-b520-43bb-b14e-1e5c55185d86 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:11.448719 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-524dcc16-b520-43bb-b14e-1e5c55185d86 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:11.456704 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-524dcc16-b520-43bb-b14e-1e5c55185d86 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.154033 Aug 05 02:31:11.457259 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 564/1129] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:11 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:11.613075 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e77d7c7c-3d81-4f9a-bcfd-3c564f6685be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4feb5b20-f599-46cc-af0e-60bf58ca98eb"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:31:11.615490 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e77d7c7c-3d81-4f9a-bcfd-3c564f6685be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:11.621781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e77d7c7c-3d81-4f9a-bcfd-3c564f6685be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:11.622259 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e77d7c7c-3d81-4f9a-bcfd-3c564f6685be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:11.622688 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e77d7c7c-3d81-4f9a-bcfd-3c564f6685be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:11.623369 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e77d7c7c-3d81-4f9a-bcfd-3c564f6685be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:11.623814 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e77d7c7c-3d81-4f9a-bcfd-3c564f6685be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:11.624233 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e77d7c7c-3d81-4f9a-bcfd-3c564f6685be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:12.478160 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6d6a7c12-6055-4d9b-b74a-b03a10069428 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:12.478770 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6d6a7c12-6055-4d9b-b74a-b03a10069428 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:12.485160 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d6a7c12-6055-4d9b-b74a-b03a10069428 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:12.485643 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d6a7c12-6055-4d9b-b74a-b03a10069428 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:12.486084 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d6a7c12-6055-4d9b-b74a-b03a10069428 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:12.486764 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d6a7c12-6055-4d9b-b74a-b03a10069428 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:12.487216 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d6a7c12-6055-4d9b-b74a-b03a10069428 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:12.487644 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6d6a7c12-6055-4d9b-b74a-b03a10069428 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:12.616621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6d6a7c12-6055-4d9b-b74a-b03a10069428 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:12.623953 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6d6a7c12-6055-4d9b-b74a-b03a10069428 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.149641 Aug 05 02:31:12.625219 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 565/1130] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:12 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:31:13.646589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d9e18da0-2999-4f9f-bf55-977a802a1648 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:13.647239 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d9e18da0-2999-4f9f-bf55-977a802a1648 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:13.653387 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d9e18da0-2999-4f9f-bf55-977a802a1648 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:13.653856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d9e18da0-2999-4f9f-bf55-977a802a1648 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:13.654284 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d9e18da0-2999-4f9f-bf55-977a802a1648 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:13.654953 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d9e18da0-2999-4f9f-bf55-977a802a1648 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:13.655397 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d9e18da0-2999-4f9f-bf55-977a802a1648 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:13.655841 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d9e18da0-2999-4f9f-bf55-977a802a1648 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:13.787878 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d9e18da0-2999-4f9f-bf55-977a802a1648 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:13.795243 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d9e18da0-2999-4f9f-bf55-977a802a1648 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.152541 Aug 05 02:31:13.795807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 566/1131] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:13 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:31:14.817950 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-fe23fe25-8933-4ef5-9383-6c2998c09fe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:14.818618 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-fe23fe25-8933-4ef5-9383-6c2998c09fe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:14.825016 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fe23fe25-8933-4ef5-9383-6c2998c09fe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:14.825421 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fe23fe25-8933-4ef5-9383-6c2998c09fe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:14.825852 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fe23fe25-8933-4ef5-9383-6c2998c09fe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:14.826596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fe23fe25-8933-4ef5-9383-6c2998c09fe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:14.826974 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fe23fe25-8933-4ef5-9383-6c2998c09fe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:14.828710 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-fe23fe25-8933-4ef5-9383-6c2998c09fe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:14.939705 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e77d7c7c-3d81-4f9a-bcfd-3c564f6685be tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "POST /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.331063 Aug 05 02:31:14.940668 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 566/1132] 10.222.0.15 () {60 vars in 1323 bytes} [Fri Aug 5 02:31:11 2022] POST /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a/os-volume_attachments => generated 194 bytes in 3333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:31:14.981036 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-fe23fe25-8933-4ef5-9383-6c2998c09fe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:14.989564 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-fe23fe25-8933-4ef5-9383-6c2998c09fe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.175368 Aug 05 02:31:14.990139 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 567/1133] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:14 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:31:16.012248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-581cdc00-8494-49cc-a987-449a50260568 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:16.013042 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-581cdc00-8494-49cc-a987-449a50260568 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:16.020061 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-581cdc00-8494-49cc-a987-449a50260568 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:16.020599 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-581cdc00-8494-49cc-a987-449a50260568 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:16.021022 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-581cdc00-8494-49cc-a987-449a50260568 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:16.021723 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-581cdc00-8494-49cc-a987-449a50260568 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:16.022176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-581cdc00-8494-49cc-a987-449a50260568 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:16.022601 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-581cdc00-8494-49cc-a987-449a50260568 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:16.156607 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-581cdc00-8494-49cc-a987-449a50260568 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:16.164202 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-581cdc00-8494-49cc-a987-449a50260568 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.156906 Aug 05 02:31:16.164799 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 567/1134] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:16 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:17.185628 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bccd06b0-2cf0-4ba9-9f0b-43e84597cde0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:17.186228 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bccd06b0-2cf0-4ba9-9f0b-43e84597cde0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:17.192807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bccd06b0-2cf0-4ba9-9f0b-43e84597cde0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:17.193280 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bccd06b0-2cf0-4ba9-9f0b-43e84597cde0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:17.193709 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bccd06b0-2cf0-4ba9-9f0b-43e84597cde0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:17.194391 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bccd06b0-2cf0-4ba9-9f0b-43e84597cde0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:17.194837 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bccd06b0-2cf0-4ba9-9f0b-43e84597cde0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:17.195252 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bccd06b0-2cf0-4ba9-9f0b-43e84597cde0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:17.339001 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-bccd06b0-2cf0-4ba9-9f0b-43e84597cde0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:17.347078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bccd06b0-2cf0-4ba9-9f0b-43e84597cde0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.165181 Aug 05 02:31:17.347646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 568/1135] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:17 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:18.368939 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-952c5d89-7b14-4dc3-ad56-ee53c648ba72 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:18.369459 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-952c5d89-7b14-4dc3-ad56-ee53c648ba72 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:18.376538 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-952c5d89-7b14-4dc3-ad56-ee53c648ba72 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:18.377016 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-952c5d89-7b14-4dc3-ad56-ee53c648ba72 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:18.377535 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-952c5d89-7b14-4dc3-ad56-ee53c648ba72 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:18.378227 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-952c5d89-7b14-4dc3-ad56-ee53c648ba72 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:18.378673 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-952c5d89-7b14-4dc3-ad56-ee53c648ba72 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:18.379104 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-952c5d89-7b14-4dc3-ad56-ee53c648ba72 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:18.510466 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-952c5d89-7b14-4dc3-ad56-ee53c648ba72 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:18.518156 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-952c5d89-7b14-4dc3-ad56-ee53c648ba72 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.153131 Aug 05 02:31:18.518719 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 568/1136] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:18 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:19.538774 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4f046f46-8fac-4c74-b3df-6178f88ff79a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:19.539378 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4f046f46-8fac-4c74-b3df-6178f88ff79a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:19.545621 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f046f46-8fac-4c74-b3df-6178f88ff79a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:19.546092 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f046f46-8fac-4c74-b3df-6178f88ff79a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:19.546520 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f046f46-8fac-4c74-b3df-6178f88ff79a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:19.547203 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f046f46-8fac-4c74-b3df-6178f88ff79a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:19.548317 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f046f46-8fac-4c74-b3df-6178f88ff79a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:19.548749 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f046f46-8fac-4c74-b3df-6178f88ff79a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:19.678872 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4f046f46-8fac-4c74-b3df-6178f88ff79a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:19.686357 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4f046f46-8fac-4c74-b3df-6178f88ff79a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.151358 Aug 05 02:31:19.686927 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 569/1137] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:19 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:20.707805 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1a4f9fd1-f584-4bc7-b63a-b28494f1f231 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:20.708435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1a4f9fd1-f584-4bc7-b63a-b28494f1f231 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:20.715091 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a4f9fd1-f584-4bc7-b63a-b28494f1f231 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:20.715513 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a4f9fd1-f584-4bc7-b63a-b28494f1f231 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:20.715945 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a4f9fd1-f584-4bc7-b63a-b28494f1f231 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:20.716675 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a4f9fd1-f584-4bc7-b63a-b28494f1f231 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:20.717122 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a4f9fd1-f584-4bc7-b63a-b28494f1f231 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:20.717547 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1a4f9fd1-f584-4bc7-b63a-b28494f1f231 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:20.852445 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1a4f9fd1-f584-4bc7-b63a-b28494f1f231 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:20.861077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1a4f9fd1-f584-4bc7-b63a-b28494f1f231 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.156995 Aug 05 02:31:20.861644 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 569/1138] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:20 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:21.882418 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-19341b47-ed87-426a-91d7-501a5f0fb877 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:21.883076 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-19341b47-ed87-426a-91d7-501a5f0fb877 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:21.900495 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19341b47-ed87-426a-91d7-501a5f0fb877 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:21.901051 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19341b47-ed87-426a-91d7-501a5f0fb877 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:21.901544 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19341b47-ed87-426a-91d7-501a5f0fb877 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:21.902330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19341b47-ed87-426a-91d7-501a5f0fb877 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:21.902892 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19341b47-ed87-426a-91d7-501a5f0fb877 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:21.903451 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-19341b47-ed87-426a-91d7-501a5f0fb877 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:22.047646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-19341b47-ed87-426a-91d7-501a5f0fb877 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:22.055192 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-19341b47-ed87-426a-91d7-501a5f0fb877 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.176657 Aug 05 02:31:22.055752 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 570/1139] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:21 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:23.077094 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1e62293f-4450-417a-9535-8f22fc90f7f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:23.077710 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1e62293f-4450-417a-9535-8f22fc90f7f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:23.084593 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e62293f-4450-417a-9535-8f22fc90f7f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:23.085007 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e62293f-4450-417a-9535-8f22fc90f7f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:23.085439 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e62293f-4450-417a-9535-8f22fc90f7f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:23.086121 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e62293f-4450-417a-9535-8f22fc90f7f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:23.086569 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e62293f-4450-417a-9535-8f22fc90f7f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:23.087235 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1e62293f-4450-417a-9535-8f22fc90f7f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:23.218273 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1e62293f-4450-417a-9535-8f22fc90f7f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:23.226524 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1e62293f-4450-417a-9535-8f22fc90f7f1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.153450 Aug 05 02:31:23.227076 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 570/1140] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:23 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:23.754200 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9da3c492-5159-4ce0-91b4-0a4b97d7c598 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:23.754729 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9da3c492-5159-4ce0-91b4-0a4b97d7c598 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:23.761016 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9da3c492-5159-4ce0-91b4-0a4b97d7c598 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:23.761490 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9da3c492-5159-4ce0-91b4-0a4b97d7c598 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:23.761915 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9da3c492-5159-4ce0-91b4-0a4b97d7c598 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:23.762591 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9da3c492-5159-4ce0-91b4-0a4b97d7c598 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:23.763032 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9da3c492-5159-4ce0-91b4-0a4b97d7c598 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:23.763445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9da3c492-5159-4ce0-91b4-0a4b97d7c598 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:23.860145 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-9da3c492-5159-4ce0-91b4-0a4b97d7c598 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lazy-loading 'services' on Instance uuid f7d0e67c-0e2b-400b-a334-b8d2fcd0758a {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:31:23.939954 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9da3c492-5159-4ce0-91b4-0a4b97d7c598 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a/os-volume_attachments/4feb5b20-f599-46cc-af0e-60bf58ca98eb" status: 202 len: 0 microversion: 2.1 time: 0.189806 Aug 05 02:31:23.940596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 571/1141] 10.222.0.15 () {58 vars in 1416 bytes} [Fri Aug 5 02:31:23 2022] DELETE /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a/os-volume_attachments/4feb5b20-f599-46cc-af0e-60bf58ca98eb => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:31:23.948876 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-de7eb28c-53bf-443a-b84c-788706c160e8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:23.951162 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-de7eb28c-53bf-443a-b84c-788706c160e8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:23.958339 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de7eb28c-53bf-443a-b84c-788706c160e8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:23.958837 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de7eb28c-53bf-443a-b84c-788706c160e8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:23.959278 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de7eb28c-53bf-443a-b84c-788706c160e8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:23.959986 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de7eb28c-53bf-443a-b84c-788706c160e8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:23.960476 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de7eb28c-53bf-443a-b84c-788706c160e8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:23.960963 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de7eb28c-53bf-443a-b84c-788706c160e8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:23.992763 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-de7eb28c-53bf-443a-b84c-788706c160e8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047744 Aug 05 02:31:23.993392 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 571/1142] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:31:23 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:31:24.248445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-97e46f0d-26d0-48ba-83d5-3700a0d3ce26 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:24.249192 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-97e46f0d-26d0-48ba-83d5-3700a0d3ce26 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:24.256049 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-97e46f0d-26d0-48ba-83d5-3700a0d3ce26 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:24.256580 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-97e46f0d-26d0-48ba-83d5-3700a0d3ce26 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:24.257017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-97e46f0d-26d0-48ba-83d5-3700a0d3ce26 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:24.257738 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-97e46f0d-26d0-48ba-83d5-3700a0d3ce26 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:24.258239 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-97e46f0d-26d0-48ba-83d5-3700a0d3ce26 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:24.258670 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-97e46f0d-26d0-48ba-83d5-3700a0d3ce26 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:24.398244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-97e46f0d-26d0-48ba-83d5-3700a0d3ce26 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:24.405873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-97e46f0d-26d0-48ba-83d5-3700a0d3ce26 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.161949 Aug 05 02:31:24.406435 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 572/1143] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:24 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:25.005429 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1b4af5db-7b24-443b-8f31-e1c44d97276c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:25.007691 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1b4af5db-7b24-443b-8f31-e1c44d97276c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:25.014222 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b4af5db-7b24-443b-8f31-e1c44d97276c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:25.014698 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b4af5db-7b24-443b-8f31-e1c44d97276c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:25.015128 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b4af5db-7b24-443b-8f31-e1c44d97276c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:25.015824 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b4af5db-7b24-443b-8f31-e1c44d97276c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:25.016269 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b4af5db-7b24-443b-8f31-e1c44d97276c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:25.016737 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1b4af5db-7b24-443b-8f31-e1c44d97276c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:25.048749 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1b4af5db-7b24-443b-8f31-e1c44d97276c tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046592 Aug 05 02:31:25.049296 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 572/1144] 10.222.0.15 () {58 vars in 1302 bytes} [Fri Aug 5 02:31:25 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 05 02:31:25.118746 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8090a3ab-d803-4da8-b6d9-917d8aaea613 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:25.119309 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8090a3ab-d803-4da8-b6d9-917d8aaea613 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:25.126237 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8090a3ab-d803-4da8-b6d9-917d8aaea613 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:25.126868 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8090a3ab-d803-4da8-b6d9-917d8aaea613 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:25.127328 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8090a3ab-d803-4da8-b6d9-917d8aaea613 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:25.128015 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8090a3ab-d803-4da8-b6d9-917d8aaea613 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:25.128504 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8090a3ab-d803-4da8-b6d9-917d8aaea613 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:25.128922 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8090a3ab-d803-4da8-b6d9-917d8aaea613 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:25.155613 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8090a3ab-d803-4da8-b6d9-917d8aaea613 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:31:25.206513 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:25.239990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8090a3ab-d803-4da8-b6d9-917d8aaea613 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 204 len: 0 microversion: 2.1 time: 0.124584 Aug 05 02:31:25.240717 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 573/1145] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:31:25 2022] DELETE /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:31:25.249210 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a0789e90-a632-463c-bf3f-9743acd6e3fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:25.249840 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a0789e90-a632-463c-bf3f-9743acd6e3fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:25.257895 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0789e90-a632-463c-bf3f-9743acd6e3fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:25.258388 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0789e90-a632-463c-bf3f-9743acd6e3fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:25.258832 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0789e90-a632-463c-bf3f-9743acd6e3fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:25.259523 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0789e90-a632-463c-bf3f-9743acd6e3fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:25.260001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0789e90-a632-463c-bf3f-9743acd6e3fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:25.260457 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a0789e90-a632-463c-bf3f-9743acd6e3fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:25.390147 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a0789e90-a632-463c-bf3f-9743acd6e3fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:25.398388 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a0789e90-a632-463c-bf3f-9743acd6e3fe tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 200 len: 1682 microversion: 2.1 time: 0.153023 Aug 05 02:31:25.398933 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 573/1146] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:25 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:25.427417 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d1ee680a-d611-42c8-8906-8306e139d351 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:25.428098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d1ee680a-d611-42c8-8906-8306e139d351 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:25.434550 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1ee680a-d611-42c8-8906-8306e139d351 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:25.435036 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1ee680a-d611-42c8-8906-8306e139d351 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:25.435464 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1ee680a-d611-42c8-8906-8306e139d351 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:25.436135 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1ee680a-d611-42c8-8906-8306e139d351 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:25.436608 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1ee680a-d611-42c8-8906-8306e139d351 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:25.437035 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d1ee680a-d611-42c8-8906-8306e139d351 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:25.571254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d1ee680a-d611-42c8-8906-8306e139d351 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:25.578686 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d1ee680a-d611-42c8-8906-8306e139d351 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.156008 Aug 05 02:31:25.579362 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 574/1147] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:25 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:26.419335 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8b841468-f683-4e80-9342-e051ce807d10 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:26.420433 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8b841468-f683-4e80-9342-e051ce807d10 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:26.428039 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b841468-f683-4e80-9342-e051ce807d10 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:26.428561 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b841468-f683-4e80-9342-e051ce807d10 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:26.428997 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b841468-f683-4e80-9342-e051ce807d10 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:26.429695 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b841468-f683-4e80-9342-e051ce807d10 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:26.430141 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b841468-f683-4e80-9342-e051ce807d10 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:26.430566 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b841468-f683-4e80-9342-e051ce807d10 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:26.601255 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-17d31492-fb5d-43fc-9aca-c04fb314d436 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:26.601847 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-17d31492-fb5d-43fc-9aca-c04fb314d436 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:26.608515 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17d31492-fb5d-43fc-9aca-c04fb314d436 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:26.608996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17d31492-fb5d-43fc-9aca-c04fb314d436 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:26.609419 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17d31492-fb5d-43fc-9aca-c04fb314d436 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:26.610114 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17d31492-fb5d-43fc-9aca-c04fb314d436 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:26.611303 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17d31492-fb5d-43fc-9aca-c04fb314d436 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:26.611723 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-17d31492-fb5d-43fc-9aca-c04fb314d436 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:26.759336 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-17d31492-fb5d-43fc-9aca-c04fb314d436 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:26.768524 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-17d31492-fb5d-43fc-9aca-c04fb314d436 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.171106 Aug 05 02:31:26.769116 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 575/1148] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:26 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:26.955603 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8b841468-f683-4e80-9342-e051ce807d10 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:26.966290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8b841468-f683-4e80-9342-e051ce807d10 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 200 len: 1682 microversion: 2.1 time: 0.550951 Aug 05 02:31:26.967205 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 574/1149] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:26 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 1682 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:27.790957 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-213b5257-a6d5-4b15-99df-eb7bac5d38b6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:27.791515 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-213b5257-a6d5-4b15-99df-eb7bac5d38b6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:27.799140 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-213b5257-a6d5-4b15-99df-eb7bac5d38b6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:27.799633 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-213b5257-a6d5-4b15-99df-eb7bac5d38b6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:27.800075 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-213b5257-a6d5-4b15-99df-eb7bac5d38b6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:27.800825 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-213b5257-a6d5-4b15-99df-eb7bac5d38b6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:27.801280 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-213b5257-a6d5-4b15-99df-eb7bac5d38b6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:27.801706 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-213b5257-a6d5-4b15-99df-eb7bac5d38b6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:27.987211 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-03ab3747-3364-46f8-8002-77be040b3fc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:27.988467 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-03ab3747-3364-46f8-8002-77be040b3fc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:27.995235 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03ab3747-3364-46f8-8002-77be040b3fc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:27.995965 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03ab3747-3364-46f8-8002-77be040b3fc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:27.996742 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03ab3747-3364-46f8-8002-77be040b3fc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:27.997644 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03ab3747-3364-46f8-8002-77be040b3fc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:27.998306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03ab3747-3364-46f8-8002-77be040b3fc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:27.998894 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03ab3747-3364-46f8-8002-77be040b3fc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:28.172343 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-03ab3747-3364-46f8-8002-77be040b3fc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:28.184761 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-03ab3747-3364-46f8-8002-77be040b3fc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 200 len: 1682 microversion: 2.1 time: 0.201530 Aug 05 02:31:28.200369 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 575/1150] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:27 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:31:28.279810 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-213b5257-a6d5-4b15-99df-eb7bac5d38b6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:28.292836 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-213b5257-a6d5-4b15-99df-eb7bac5d38b6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.506349 Aug 05 02:31:28.308430 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 576/1151] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:27 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:29.098338 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-07d594d5-c474-4435-8589-0481786a72b7 req-7b0f941b-2c50-44fe-8411-e69ffe536e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d0e67c-0e2b-400b-a334-b8d2fcd0758a", "name": "network-vif-deleted", "tag": "4d4a4290-997a-4edf-84d1-d7b7d68048c0"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:31:29.108785 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-07d594d5-c474-4435-8589-0481786a72b7 req-7b0f941b-2c50-44fe-8411-e69ffe536e72 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:29.109471 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-07d594d5-c474-4435-8589-0481786a72b7 req-7b0f941b-2c50-44fe-8411-e69ffe536e72 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:29.110117 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-07d594d5-c474-4435-8589-0481786a72b7 req-7b0f941b-2c50-44fe-8411-e69ffe536e72 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:29.123379 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-07d594d5-c474-4435-8589-0481786a72b7 req-7b0f941b-2c50-44fe-8411-e69ffe536e72 service nova] Creating event network-vif-deleted:4d4a4290-997a-4edf-84d1-d7b7d68048c0 for instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a on hv-cinder-81558 Aug 05 02:31:29.135163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-07d594d5-c474-4435-8589-0481786a72b7 req-7b0f941b-2c50-44fe-8411-e69ffe536e72 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206132 Aug 05 02:31:29.140678 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 576/1152] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:31:29.212485 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b130ab61-bcc5-468c-b7b9-63bf9d5af330 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:29.213104 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b130ab61-bcc5-468c-b7b9-63bf9d5af330 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:29.219416 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b130ab61-bcc5-468c-b7b9-63bf9d5af330 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:29.220609 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b130ab61-bcc5-468c-b7b9-63bf9d5af330 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:29.221079 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b130ab61-bcc5-468c-b7b9-63bf9d5af330 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:29.222196 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b130ab61-bcc5-468c-b7b9-63bf9d5af330 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:29.222889 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b130ab61-bcc5-468c-b7b9-63bf9d5af330 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:29.223774 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b130ab61-bcc5-468c-b7b9-63bf9d5af330 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:29.300625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b130ab61-bcc5-468c-b7b9-63bf9d5af330 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:29.308986 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b130ab61-bcc5-468c-b7b9-63bf9d5af330 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 200 len: 1614 microversion: 2.1 time: 0.100533 Aug 05 02:31:29.309792 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 577/1153] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:29 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 1614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:29.320561 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4df5454f-b145-45c3-a991-43a5feef7695 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:29.321272 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4df5454f-b145-45c3-a991-43a5feef7695 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:29.327560 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4df5454f-b145-45c3-a991-43a5feef7695 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:29.328051 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4df5454f-b145-45c3-a991-43a5feef7695 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:29.328525 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4df5454f-b145-45c3-a991-43a5feef7695 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:29.329934 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4df5454f-b145-45c3-a991-43a5feef7695 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:29.330399 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4df5454f-b145-45c3-a991-43a5feef7695 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:29.330828 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4df5454f-b145-45c3-a991-43a5feef7695 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:29.466266 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4df5454f-b145-45c3-a991-43a5feef7695 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:29.473943 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4df5454f-b145-45c3-a991-43a5feef7695 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.162008 Aug 05 02:31:29.474514 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 577/1154] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:29 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:31:30.330707 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-10e6cc2b-ddcc-46e4-9739-312e7b4620e1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:30.331320 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-10e6cc2b-ddcc-46e4-9739-312e7b4620e1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:30.338058 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10e6cc2b-ddcc-46e4-9739-312e7b4620e1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:30.338646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10e6cc2b-ddcc-46e4-9739-312e7b4620e1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:30.339074 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10e6cc2b-ddcc-46e4-9739-312e7b4620e1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:30.339774 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10e6cc2b-ddcc-46e4-9739-312e7b4620e1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:30.340249 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10e6cc2b-ddcc-46e4-9739-312e7b4620e1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:30.340669 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10e6cc2b-ddcc-46e4-9739-312e7b4620e1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:30.374643 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10e6cc2b-ddcc-46e4-9739-312e7b4620e1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:30.375327 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10e6cc2b-ddcc-46e4-9739-312e7b4620e1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:30.376679 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-10e6cc2b-ddcc-46e4-9739-312e7b4620e1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:30.377757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.objects.instance [None req-10e6cc2b-ddcc-46e4-9739-312e7b4620e1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lazy-loading 'fault' on Instance uuid f7d0e67c-0e2b-400b-a334-b8d2fcd0758a {{(pid=117921) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:31:30.427154 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-10e6cc2b-ddcc-46e4-9739-312e7b4620e1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '600f51be8202427fb3691db566ed2ff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6a220b99d94a648150476bf0a01e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:30.435335 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-10e6cc2b-ddcc-46e4-9739-312e7b4620e1 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 200 len: 1331 microversion: 2.1 time: 0.108833 Aug 05 02:31:30.436384 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 578/1155] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:30 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:30.495791 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0f00cae0-ff51-4271-ab05-6f6e39c060fa tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:30.497207 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0f00cae0-ff51-4271-ab05-6f6e39c060fa tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:30.504364 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f00cae0-ff51-4271-ab05-6f6e39c060fa tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:30.505067 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f00cae0-ff51-4271-ab05-6f6e39c060fa tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:30.505502 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f00cae0-ff51-4271-ab05-6f6e39c060fa tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:30.506202 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f00cae0-ff51-4271-ab05-6f6e39c060fa tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:30.506954 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f00cae0-ff51-4271-ab05-6f6e39c060fa tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:30.507094 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0f00cae0-ff51-4271-ab05-6f6e39c060fa tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:30.651998 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0f00cae0-ff51-4271-ab05-6f6e39c060fa tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:30.656009 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:30.662726 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0f00cae0-ff51-4271-ab05-6f6e39c060fa tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.171376 Aug 05 02:31:30.663277 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 578/1156] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:30 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:31.459318 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-04d4f7d8-4c9e-4ecd-a25f-e1568815033b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:31.459904 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-04d4f7d8-4c9e-4ecd-a25f-e1568815033b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:31.466528 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04d4f7d8-4c9e-4ecd-a25f-e1568815033b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:31.467004 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04d4f7d8-4c9e-4ecd-a25f-e1568815033b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:31.467436 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04d4f7d8-4c9e-4ecd-a25f-e1568815033b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:31.468114 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04d4f7d8-4c9e-4ecd-a25f-e1568815033b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:31.468593 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04d4f7d8-4c9e-4ecd-a25f-e1568815033b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:31.469013 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-04d4f7d8-4c9e-4ecd-a25f-e1568815033b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:31.481901 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-04d4f7d8-4c9e-4ecd-a25f-e1568815033b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] HTTP exception thrown: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-04d4f7d8-4c9e-4ecd-a25f-e1568815033b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Request method failure captured: Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a HTTP/1.1 Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5pSyPEti3j-9gLBxlgA1L_GuWB6iJvenWVBmfr31mrg4vu4HTgr4mx0c2q3ZmjrMdxdtLzCg8wRia849DSEc7AfP2crmxulEg45Cq3I2oORZ75mc5ksg7ZmJKJ4cA2qZbyq7NZRhJeqx1H2xWUpibdSGnuQ0avaMqjO9VbCjnpzbo Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:31:31.483512 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:31:31.485244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ad6a220b99d94a648150476bf0a01e50", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}] Aug 05 02:31:31.485244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:31.485244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:31.485244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:31.485244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:31.485244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:31:31.485244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:31:31.485244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 600f51be8202427fb3691db566ed2ff2 Aug 05 02:31:31.485244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:31.485244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:31:31.485244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. Aug 05 02:31:31.485244 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': 'f7d0e67c-0e2b-400b-a334-b8d2fcd0758a'} Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:31:31.486179 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. Aug 05 02:31:31.487807 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:31.489207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-04d4f7d8-4c9e-4ecd-a25f-e1568815033b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Returning 404 to user: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:31:31.489207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-04d4f7d8-4c9e-4ecd-a25f-e1568815033b tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 404 len: 111 microversion: 2.1 time: 0.029513 Aug 05 02:31:31.489207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 579/1157] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:31 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:31:31.493691 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d65490e7-a21c-4de7-aee0-4fd59786dd44 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '.version_select at 0x7fa65c6fe790>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:31.514798 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d65490e7-a21c-4de7-aee0-4fd59786dd44 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1847034072" status: 202 len: 0 microversion: 2.1 time: 0.024817 Aug 05 02:31:31.515488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 579/1158] 10.222.0.15 () {58 vars in 1221 bytes} [Fri Aug 5 02:31:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1847034072 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:31:31.684392 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f4f8b423-5ab4-4ec7-b400-82f7e3cc19ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:31.685001 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f4f8b423-5ab4-4ec7-b400-82f7e3cc19ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:31.692133 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f4f8b423-5ab4-4ec7-b400-82f7e3cc19ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:31.692636 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f4f8b423-5ab4-4ec7-b400-82f7e3cc19ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:31.693064 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f4f8b423-5ab4-4ec7-b400-82f7e3cc19ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:31.693754 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f4f8b423-5ab4-4ec7-b400-82f7e3cc19ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:31.694200 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f4f8b423-5ab4-4ec7-b400-82f7e3cc19ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:31.694622 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f4f8b423-5ab4-4ec7-b400-82f7e3cc19ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:31.830633 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f4f8b423-5ab4-4ec7-b400-82f7e3cc19ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:31.838907 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f4f8b423-5ab4-4ec7-b400-82f7e3cc19ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1510 microversion: 2.1 time: 0.158491 Aug 05 02:31:31.839561 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 580/1159] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:31 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:31.860681 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6dd49148-3452-48a3-a583-bed86bdcde3a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:31:31.861276 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6dd49148-3452-48a3-a583-bed86bdcde3a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:31.867068 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd49148-3452-48a3-a583-bed86bdcde3a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:31.867544 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd49148-3452-48a3-a583-bed86bdcde3a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:31.867975 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd49148-3452-48a3-a583-bed86bdcde3a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:31.868685 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd49148-3452-48a3-a583-bed86bdcde3a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:31.869141 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd49148-3452-48a3-a583-bed86bdcde3a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:31.869556 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6dd49148-3452-48a3-a583-bed86bdcde3a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:31.900690 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6dd49148-3452-48a3-a583-bed86bdcde3a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117920) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 05 02:31:31.967522 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6dd49148-3452-48a3-a583-bed86bdcde3a tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "POST /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab/action" status: 202 len: 0 microversion: 2.1 time: 0.110787 Aug 05 02:31:31.968493 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 580/1160] 10.222.0.15 () {60 vars in 1278 bytes} [Fri Aug 5 02:31:31 2022] POST /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:31:31.977475 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-d0f0c2e8-be11-4fde-9f59-e8dfc101bfcf tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:31.978095 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-d0f0c2e8-be11-4fde-9f59-e8dfc101bfcf tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:31.986870 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d0f0c2e8-be11-4fde-9f59-e8dfc101bfcf tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:31.987490 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d0f0c2e8-be11-4fde-9f59-e8dfc101bfcf tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:31.988114 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d0f0c2e8-be11-4fde-9f59-e8dfc101bfcf tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:31.989225 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d0f0c2e8-be11-4fde-9f59-e8dfc101bfcf tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:31.989820 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d0f0c2e8-be11-4fde-9f59-e8dfc101bfcf tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:31.990393 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-d0f0c2e8-be11-4fde-9f59-e8dfc101bfcf tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:32.199181 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-d0f0c2e8-be11-4fde-9f59-e8dfc101bfcf tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:32.207826 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-d0f0c2e8-be11-4fde-9f59-e8dfc101bfcf tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1518 microversion: 2.1 time: 0.235056 Aug 05 02:31:32.224027 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 581/1161] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:31 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1518 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:33.231414 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0b6227b1-d3c3-46d5-a3a0-3fea60f75afe tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:33.232071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0b6227b1-d3c3-46d5-a3a0-3fea60f75afe tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:33.238540 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0b6227b1-d3c3-46d5-a3a0-3fea60f75afe tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:33.239016 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0b6227b1-d3c3-46d5-a3a0-3fea60f75afe tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:33.239457 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0b6227b1-d3c3-46d5-a3a0-3fea60f75afe tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:33.240146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0b6227b1-d3c3-46d5-a3a0-3fea60f75afe tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:33.240633 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0b6227b1-d3c3-46d5-a3a0-3fea60f75afe tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:33.241074 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0b6227b1-d3c3-46d5-a3a0-3fea60f75afe tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:33.375160 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0b6227b1-d3c3-46d5-a3a0-3fea60f75afe tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:33.383503 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0b6227b1-d3c3-46d5-a3a0-3fea60f75afe tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1518 microversion: 2.1 time: 0.156629 Aug 05 02:31:33.384066 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 581/1162] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:33 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:34.404386 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b187fd52-6284-4519-a032-0f06a6c0a8b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:34.404990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b187fd52-6284-4519-a032-0f06a6c0a8b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:34.411721 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b187fd52-6284-4519-a032-0f06a6c0a8b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:34.412189 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b187fd52-6284-4519-a032-0f06a6c0a8b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:34.412645 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b187fd52-6284-4519-a032-0f06a6c0a8b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:34.413318 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b187fd52-6284-4519-a032-0f06a6c0a8b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:34.413760 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b187fd52-6284-4519-a032-0f06a6c0a8b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:34.414176 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b187fd52-6284-4519-a032-0f06a6c0a8b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:34.543249 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b187fd52-6284-4519-a032-0f06a6c0a8b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:34.550843 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b187fd52-6284-4519-a032-0f06a6c0a8b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1518 microversion: 2.1 time: 0.150263 Aug 05 02:31:34.551414 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 582/1163] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:34 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:35.168799 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-9737f19a-b84a-4508-8dc9-852139bc2655 req-09c67e23-ea2a-4f20-b666-f8c63a27e2fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb56ea7-8771-41b9-b537-a6d4afeda7ab", "name": "network-vif-unplugged", "status": "completed", "tag": "652b8180-4f83-4880-81b9-b44df98605a9"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:31:35.178981 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9737f19a-b84a-4508-8dc9-852139bc2655 req-09c67e23-ea2a-4f20-b666-f8c63a27e2fb service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:35.179533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9737f19a-b84a-4508-8dc9-852139bc2655 req-09c67e23-ea2a-4f20-b666-f8c63a27e2fb service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:35.180128 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9737f19a-b84a-4508-8dc9-852139bc2655 req-09c67e23-ea2a-4f20-b666-f8c63a27e2fb service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:35.193261 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.compute.server_external_events [req-9737f19a-b84a-4508-8dc9-852139bc2655 req-09c67e23-ea2a-4f20-b666-f8c63a27e2fb service nova] Unable to find a host for instance 5eb56ea7-8771-41b9-b537-a6d4afeda7ab. Dropping event network-vif-unplugged {{(pid=117920) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 05 02:31:35.194543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-9737f19a-b84a-4508-8dc9-852139bc2655 req-09c67e23-ea2a-4f20-b666-f8c63a27e2fb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029387 Aug 05 02:31:35.195187 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 582/1164] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 05 02:31:35.401205 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-00027125-b92f-46c4-99f6-0d41ba0fbb0e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:35.401703 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-00027125-b92f-46c4-99f6-0d41ba0fbb0e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:35.407836 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00027125-b92f-46c4-99f6-0d41ba0fbb0e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:35.408937 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00027125-b92f-46c4-99f6-0d41ba0fbb0e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:35.408937 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00027125-b92f-46c4-99f6-0d41ba0fbb0e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:35.409580 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00027125-b92f-46c4-99f6-0d41ba0fbb0e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:35.410025 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00027125-b92f-46c4-99f6-0d41ba0fbb0e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:35.410442 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-00027125-b92f-46c4-99f6-0d41ba0fbb0e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:35.424746 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-00027125-b92f-46c4-99f6-0d41ba0fbb0e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] HTTP exception thrown: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-00027125-b92f-46c4-99f6-0d41ba0fbb0e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Request method failure captured: Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a HTTP/1.1 Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5pSyPEti3j-9gLBxlgA1L_GuWB6iJvenWVBmfr31mrg4vu4HTgr4mx0c2q3ZmjrMdxdtLzCg8wRia849DSEc7AfP2crmxulEg45Cq3I2oORZ75mc5ksg7ZmJKJ4cA2qZbyq7NZRhJeqx1H2xWUpibdSGnuQ0avaMqjO9VbCjnpzbo Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:31:35.426070 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:31:35.427683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ad6a220b99d94a648150476bf0a01e50", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}] Aug 05 02:31:35.427683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:35.427683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:35.427683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:35.427683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:35.427683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:31:35.427683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:31:35.427683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 600f51be8202427fb3691db566ed2ff2 Aug 05 02:31:35.427683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:35.427683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:31:35.427683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. Aug 05 02:31:35.427683 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': 'f7d0e67c-0e2b-400b-a334-b8d2fcd0758a'} Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:31:35.428998 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. Aug 05 02:31:35.430596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:35.433402 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-00027125-b92f-46c4-99f6-0d41ba0fbb0e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Returning 404 to user: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:31:35.433402 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-00027125-b92f-46c4-99f6-0d41ba0fbb0e tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 404 len: 111 microversion: 2.1 time: 0.030127 Aug 05 02:31:35.433402 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 583/1165] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:31:35 2022] DELETE /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:31:35.436641 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-55f96fb4-fbb4-4464-9d7b-5f27e638c9f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:35.437255 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-55f96fb4-fbb4-4464-9d7b-5f27e638c9f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: f7d0e67c-0e2b-400b-a334-b8d2fcd0758a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:35.444238 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55f96fb4-fbb4-4464-9d7b-5f27e638c9f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:35.444832 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55f96fb4-fbb4-4464-9d7b-5f27e638c9f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:35.445273 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55f96fb4-fbb4-4464-9d7b-5f27e638c9f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:35.445968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55f96fb4-fbb4-4464-9d7b-5f27e638c9f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:35.446409 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55f96fb4-fbb4-4464-9d7b-5f27e638c9f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:35.446837 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55f96fb4-fbb4-4464-9d7b-5f27e638c9f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:35.460260 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-55f96fb4-fbb4-4464-9d7b-5f27e638c9f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] HTTP exception thrown: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-55f96fb4-fbb4-4464-9d7b-5f27e638c9f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Request method failure captured: Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a HTTP/1.1 Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5pSyPEti3j-9gLBxlgA1L_GuWB6iJvenWVBmfr31mrg4vu4HTgr4mx0c2q3ZmjrMdxdtLzCg8wRia849DSEc7AfP2crmxulEg45Cq3I2oORZ75mc5ksg7ZmJKJ4cA2qZbyq7NZRhJeqx1H2xWUpibdSGnuQ0avaMqjO9VbCjnpzbo Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:31:35.461953 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:31:35.463708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ad6a220b99d94a648150476bf0a01e50", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}] Aug 05 02:31:35.463708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:35.463708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:35.463708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:35.463708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:35.463708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:31:35.463708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:31:35.463708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 600f51be8202427fb3691db566ed2ff2 Aug 05 02:31:35.463708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:35.463708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:31:35.463708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. Aug 05 02:31:35.463708 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': 'f7d0e67c-0e2b-400b-a334-b8d2fcd0758a'} Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:31:35.464768 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. Aug 05 02:31:35.466449 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:35.468100 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-55f96fb4-fbb4-4464-9d7b-5f27e638c9f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Returning 404 to user: Instance f7d0e67c-0e2b-400b-a334-b8d2fcd0758a could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:31:35.468100 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-55f96fb4-fbb4-4464-9d7b-5f27e638c9f8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a" status: 404 len: 111 microversion: 2.1 time: 0.030819 Aug 05 02:31:35.468100 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 583/1166] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:35 2022] GET /compute/v2.1/servers/f7d0e67c-0e2b-400b-a334-b8d2fcd0758a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:31:35.579268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a7de0271-1c1e-40d3-8611-70380a2ede24 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:35.579902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a7de0271-1c1e-40d3-8611-70380a2ede24 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:35.585949 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7de0271-1c1e-40d3-8611-70380a2ede24 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:35.586422 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7de0271-1c1e-40d3-8611-70380a2ede24 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:35.586850 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7de0271-1c1e-40d3-8611-70380a2ede24 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:35.587787 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7de0271-1c1e-40d3-8611-70380a2ede24 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:35.588230 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7de0271-1c1e-40d3-8611-70380a2ede24 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:35.588678 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a7de0271-1c1e-40d3-8611-70380a2ede24 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:35.744789 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a7de0271-1c1e-40d3-8611-70380a2ede24 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:35.753589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a7de0271-1c1e-40d3-8611-70380a2ede24 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1520 microversion: 2.1 time: 0.178234 Aug 05 02:31:35.754142 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 584/1167] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:35 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:36.605083 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-14b0181b-f922-4690-8424-474ee491ef70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:36.605674 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-14b0181b-f922-4690-8424-474ee491ef70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:36.608019 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:36.613560 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14b0181b-f922-4690-8424-474ee491ef70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:36.614063 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14b0181b-f922-4690-8424-474ee491ef70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:36.614493 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14b0181b-f922-4690-8424-474ee491ef70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:36.615186 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14b0181b-f922-4690-8424-474ee491ef70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:36.615632 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14b0181b-f922-4690-8424-474ee491ef70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:36.616084 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-14b0181b-f922-4690-8424-474ee491ef70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:36.631827 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-14b0181b-f922-4690-8424-474ee491ef70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] HTTP exception thrown: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-14b0181b-f922-4690-8424-474ee491ef70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Request method failure captured: Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 HTTP/1.1 Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5pSyPEti3j-9gLBxlgA1L_GuWB6iJvenWVBmfr31mrg4vu4HTgr4mx0c2q3ZmjrMdxdtLzCg8wRia849DSEc7AfP2crmxulEg45Cq3I2oORZ75mc5ksg7ZmJKJ4cA2qZbyq7NZRhJeqx1H2xWUpibdSGnuQ0avaMqjO9VbCjnpzbo Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:31:36.633475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:31:36.635448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ad6a220b99d94a648150476bf0a01e50", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}] Aug 05 02:31:36.635448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:36.635448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:36.635448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:36.635448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:36.635448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:31:36.635448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:31:36.635448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 600f51be8202427fb3691db566ed2ff2 Aug 05 02:31:36.635448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:36.635448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:31:36.635448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. Aug 05 02:31:36.635448 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '17a74b7e-5eed-4b83-8abb-d300e6662c14'} Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:31:36.636495 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. Aug 05 02:31:36.638050 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.639832 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-14b0181b-f922-4690-8424-474ee491ef70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Returning 404 to user: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:31:36.639832 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-14b0181b-f922-4690-8424-474ee491ef70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "DELETE /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 404 len: 111 microversion: 2.1 time: 0.033792 Aug 05 02:31:36.639832 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 584/1168] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:31:36 2022] DELETE /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:31:36.646909 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a2359de8-d7b6-41b1-ae2a-3940c6fd905a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:36.647647 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a2359de8-d7b6-41b1-ae2a-3940c6fd905a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 17a74b7e-5eed-4b83-8abb-d300e6662c14] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:36.650645 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:36.656127 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2359de8-d7b6-41b1-ae2a-3940c6fd905a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:36.656631 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2359de8-d7b6-41b1-ae2a-3940c6fd905a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:36.657059 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2359de8-d7b6-41b1-ae2a-3940c6fd905a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:36.657744 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2359de8-d7b6-41b1-ae2a-3940c6fd905a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:36.658821 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2359de8-d7b6-41b1-ae2a-3940c6fd905a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:36.659252 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a2359de8-d7b6-41b1-ae2a-3940c6fd905a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:36.675540 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-a2359de8-d7b6-41b1-ae2a-3940c6fd905a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] HTTP exception thrown: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a2359de8-d7b6-41b1-ae2a-3940c6fd905a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Request method failure captured: Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 HTTP/1.1 Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5pSyPEti3j-9gLBxlgA1L_GuWB6iJvenWVBmfr31mrg4vu4HTgr4mx0c2q3ZmjrMdxdtLzCg8wRia849DSEc7AfP2crmxulEg45Cq3I2oORZ75mc5ksg7ZmJKJ4cA2qZbyq7NZRhJeqx1H2xWUpibdSGnuQ0avaMqjO9VbCjnpzbo Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:31:36.677101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:31:36.678688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ad6a220b99d94a648150476bf0a01e50", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}] Aug 05 02:31:36.678688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:36.678688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:36.678688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:36.678688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:36.678688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:31:36.678688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:31:36.678688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 600f51be8202427fb3691db566ed2ff2 Aug 05 02:31:36.678688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:36.678688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:31:36.678688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. Aug 05 02:31:36.678688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': '17a74b7e-5eed-4b83-8abb-d300e6662c14'} Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:31:36.679626 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. Aug 05 02:31:36.681132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.682419 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a2359de8-d7b6-41b1-ae2a-3940c6fd905a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Returning 404 to user: Instance 17a74b7e-5eed-4b83-8abb-d300e6662c14 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:31:36.682419 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a2359de8-d7b6-41b1-ae2a-3940c6fd905a tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14" status: 404 len: 111 microversion: 2.1 time: 0.037259 Aug 05 02:31:36.682419 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 585/1169] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:36 2022] GET /compute/v2.1/servers/17a74b7e-5eed-4b83-8abb-d300e6662c14 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:31:36.687013 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e5ba1a7-02cf-4453-a8ce-6029b8e29e70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:36.687511 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7e5ba1a7-02cf-4453-a8ce-6029b8e29e70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:36.694071 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e5ba1a7-02cf-4453-a8ce-6029b8e29e70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:36.694550 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e5ba1a7-02cf-4453-a8ce-6029b8e29e70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:36.694986 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e5ba1a7-02cf-4453-a8ce-6029b8e29e70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:36.695674 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e5ba1a7-02cf-4453-a8ce-6029b8e29e70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:36.696128 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e5ba1a7-02cf-4453-a8ce-6029b8e29e70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:36.696592 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e5ba1a7-02cf-4453-a8ce-6029b8e29e70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:36.710879 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-7e5ba1a7-02cf-4453-a8ce-6029b8e29e70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] HTTP exception thrown: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e5ba1a7-02cf-4453-a8ce-6029b8e29e70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Request method failure captured: Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c HTTP/1.1 Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5pSyPEti3j-9gLBxlgA1L_GuWB6iJvenWVBmfr31mrg4vu4HTgr4mx0c2q3ZmjrMdxdtLzCg8wRia849DSEc7AfP2crmxulEg45Cq3I2oORZ75mc5ksg7ZmJKJ4cA2qZbyq7NZRhJeqx1H2xWUpibdSGnuQ0avaMqjO9VbCjnpzbo Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:31:36.712721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:31:36.714396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ad6a220b99d94a648150476bf0a01e50", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}] Aug 05 02:31:36.714396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:36.714396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:36.714396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:36.714396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:36.714396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:31:36.714396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:31:36.714396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 600f51be8202427fb3691db566ed2ff2 Aug 05 02:31:36.714396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:36.714396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:31:36.714396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. Aug 05 02:31:36.714396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '184f7bdb-49dd-4b9c-864d-e07bdb888d6c'} Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:31:36.715397 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. Aug 05 02:31:36.716959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.718607 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e5ba1a7-02cf-4453-a8ce-6029b8e29e70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Returning 404 to user: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:31:36.718607 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7e5ba1a7-02cf-4453-a8ce-6029b8e29e70 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "DELETE /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 404 len: 111 microversion: 2.1 time: 0.030996 Aug 05 02:31:36.718607 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 585/1170] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:31:36 2022] DELETE /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:31:36.722482 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-60c5627a-842c-40df-9f4e-3dd46d91bcc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:36.723083 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-60c5627a-842c-40df-9f4e-3dd46d91bcc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 184f7bdb-49dd-4b9c-864d-e07bdb888d6c] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:36.728941 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60c5627a-842c-40df-9f4e-3dd46d91bcc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:36.729410 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60c5627a-842c-40df-9f4e-3dd46d91bcc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:36.729834 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60c5627a-842c-40df-9f4e-3dd46d91bcc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:36.730507 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60c5627a-842c-40df-9f4e-3dd46d91bcc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:36.730951 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60c5627a-842c-40df-9f4e-3dd46d91bcc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:36.731378 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-60c5627a-842c-40df-9f4e-3dd46d91bcc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:36.744593 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-60c5627a-842c-40df-9f4e-3dd46d91bcc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] HTTP exception thrown: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-60c5627a-842c-40df-9f4e-3dd46d91bcc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Request method failure captured: Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c HTTP/1.1 Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5pSyPEti3j-9gLBxlgA1L_GuWB6iJvenWVBmfr31mrg4vu4HTgr4mx0c2q3ZmjrMdxdtLzCg8wRia849DSEc7AfP2crmxulEg45Cq3I2oORZ75mc5ksg7ZmJKJ4cA2qZbyq7NZRhJeqx1H2xWUpibdSGnuQ0avaMqjO9VbCjnpzbo Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:31:36.746078 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:31:36.747588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ad6a220b99d94a648150476bf0a01e50", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}] Aug 05 02:31:36.747588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:36.747588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:36.747588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:36.747588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:36.747588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:31:36.747588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:31:36.747588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 600f51be8202427fb3691db566ed2ff2 Aug 05 02:31:36.747588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:36.747588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:31:36.747588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. Aug 05 02:31:36.747588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': '184f7bdb-49dd-4b9c-864d-e07bdb888d6c'} Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:31:36.748595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. Aug 05 02:31:36.750080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:36.752245 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-60c5627a-842c-40df-9f4e-3dd46d91bcc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Returning 404 to user: Instance 184f7bdb-49dd-4b9c-864d-e07bdb888d6c could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:31:36.752245 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-60c5627a-842c-40df-9f4e-3dd46d91bcc8 tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c" status: 404 len: 111 microversion: 2.1 time: 0.028814 Aug 05 02:31:36.752245 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 586/1171] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:36 2022] GET /compute/v2.1/servers/184f7bdb-49dd-4b9c-864d-e07bdb888d6c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:31:36.774863 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-151fe5c6-006b-4037-a843-bdc750feb74e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:36.775405 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-151fe5c6-006b-4037-a843-bdc750feb74e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:36.781347 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-151fe5c6-006b-4037-a843-bdc750feb74e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:36.781829 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-151fe5c6-006b-4037-a843-bdc750feb74e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:36.782262 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-151fe5c6-006b-4037-a843-bdc750feb74e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:36.782955 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-151fe5c6-006b-4037-a843-bdc750feb74e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:36.784077 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-151fe5c6-006b-4037-a843-bdc750feb74e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:36.784565 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-151fe5c6-006b-4037-a843-bdc750feb74e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:36.955528 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-151fe5c6-006b-4037-a843-bdc750feb74e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:36.963398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-151fe5c6-006b-4037-a843-bdc750feb74e tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1576 microversion: 2.1 time: 0.192369 Aug 05 02:31:36.963939 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 586/1172] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:36 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1576 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:37.900595 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8c1b7605-b820-46da-8b03-ad18af72606f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:37.901159 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8c1b7605-b820-46da-8b03-ad18af72606f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:37.907428 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8c1b7605-b820-46da-8b03-ad18af72606f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:37.907899 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8c1b7605-b820-46da-8b03-ad18af72606f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:37.908982 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8c1b7605-b820-46da-8b03-ad18af72606f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:37.909660 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8c1b7605-b820-46da-8b03-ad18af72606f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:37.910106 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8c1b7605-b820-46da-8b03-ad18af72606f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:37.910523 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8c1b7605-b820-46da-8b03-ad18af72606f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:37.923914 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-8c1b7605-b820-46da-8b03-ad18af72606f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] HTTP exception thrown: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8c1b7605-b820-46da-8b03-ad18af72606f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Request method failure captured: Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 HTTP/1.1 Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5pSyPEti3j-9gLBxlgA1L_GuWB6iJvenWVBmfr31mrg4vu4HTgr4mx0c2q3ZmjrMdxdtLzCg8wRia849DSEc7AfP2crmxulEg45Cq3I2oORZ75mc5ksg7ZmJKJ4cA2qZbyq7NZRhJeqx1H2xWUpibdSGnuQ0avaMqjO9VbCjnpzbo Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:31:37.925457 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:31:37.927098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ad6a220b99d94a648150476bf0a01e50", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}] Aug 05 02:31:37.927098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:37.927098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:37.927098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:37.927098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:37.927098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:31:37.927098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:31:37.927098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 600f51be8202427fb3691db566ed2ff2 Aug 05 02:31:37.927098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:37.927098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:31:37.927098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. Aug 05 02:31:37.927098 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': '1a387642-9e46-4a64-8017-43786f426b70'} Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:31:37.928006 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. Aug 05 02:31:37.929611 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:37.931195 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8c1b7605-b820-46da-8b03-ad18af72606f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Returning 404 to user: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:31:37.931195 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8c1b7605-b820-46da-8b03-ad18af72606f tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 404 len: 111 microversion: 2.1 time: 0.030074 Aug 05 02:31:37.931195 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 587/1173] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:31:37 2022] DELETE /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:31:37.935386 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a8ad2211-630f-44b1-8f25-cdf0cdd8994d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:37.936010 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a8ad2211-630f-44b1-8f25-cdf0cdd8994d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] [instance: 1a387642-9e46-4a64-8017-43786f426b70] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:37.943146 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8ad2211-630f-44b1-8f25-cdf0cdd8994d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:37.943630 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8ad2211-630f-44b1-8f25-cdf0cdd8994d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:37.944065 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8ad2211-630f-44b1-8f25-cdf0cdd8994d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:37.944792 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8ad2211-630f-44b1-8f25-cdf0cdd8994d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:37.945246 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8ad2211-630f-44b1-8f25-cdf0cdd8994d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:37.945668 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a8ad2211-630f-44b1-8f25-cdf0cdd8994d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:37.959933 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-a8ad2211-630f-44b1-8f25-cdf0cdd8994d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] HTTP exception thrown: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a8ad2211-630f-44b1-8f25-cdf0cdd8994d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Request method failure captured: Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 HTTP/1.1 Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5pSyPEti3j-9gLBxlgA1L_GuWB6iJvenWVBmfr31mrg4vu4HTgr4mx0c2q3ZmjrMdxdtLzCg8wRia849DSEc7AfP2crmxulEg45Cq3I2oORZ75mc5ksg7ZmJKJ4cA2qZbyq7NZRhJeqx1H2xWUpibdSGnuQ0avaMqjO9VbCjnpzbo Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:31:37.961501 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:31:37.963431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ad6a220b99d94a648150476bf0a01e50", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ad6a220b99d94a648150476bf0a01e50"}]}] Aug 05 02:31:37.963431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:37.963431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: ad6a220b99d94a648150476bf0a01e50 Aug 05 02:31:37.963431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-362340237 Aug 05 02:31:37.963431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:37.963431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:31:37.963431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:31:37.963431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 600f51be8202427fb3691db566ed2ff2 Aug 05 02:31:37.963431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-362340237-project Aug 05 02:31:37.963431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:31:37.963431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. Aug 05 02:31:37.963431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '1a387642-9e46-4a64-8017-43786f426b70'} Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:31:37.964398 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. Aug 05 02:31:37.965918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:37.967277 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a8ad2211-630f-44b1-8f25-cdf0cdd8994d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] Returning 404 to user: Instance 1a387642-9e46-4a64-8017-43786f426b70 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:31:37.967277 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a8ad2211-630f-44b1-8f25-cdf0cdd8994d tempest-AttachVolumeNegativeTest-362340237 tempest-AttachVolumeNegativeTest-362340237-project] 10.222.0.15 "GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70" status: 404 len: 111 microversion: 2.1 time: 0.031664 Aug 05 02:31:37.967277 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 587/1174] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:37 2022] GET /compute/v2.1/servers/1a387642-9e46-4a64-8017-43786f426b70 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:31:37.984974 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ff54b8dc-3b67-4a82-9d42-77b77ba69de3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:37.986186 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ff54b8dc-3b67-4a82-9d42-77b77ba69de3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:37.992552 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff54b8dc-3b67-4a82-9d42-77b77ba69de3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:37.993030 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff54b8dc-3b67-4a82-9d42-77b77ba69de3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:37.993633 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff54b8dc-3b67-4a82-9d42-77b77ba69de3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:37.994324 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff54b8dc-3b67-4a82-9d42-77b77ba69de3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:37.994773 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff54b8dc-3b67-4a82-9d42-77b77ba69de3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:37.995191 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ff54b8dc-3b67-4a82-9d42-77b77ba69de3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:38.150067 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ff54b8dc-3b67-4a82-9d42-77b77ba69de3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:38.159271 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ff54b8dc-3b67-4a82-9d42-77b77ba69de3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1576 microversion: 2.1 time: 0.178542 Aug 05 02:31:38.159849 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 588/1175] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:37 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:39.181096 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d6f6d103-0952-4d39-a4a3-7029799ebfe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:39.181631 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d6f6d103-0952-4d39-a4a3-7029799ebfe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:39.188062 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6f6d103-0952-4d39-a4a3-7029799ebfe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:39.188578 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6f6d103-0952-4d39-a4a3-7029799ebfe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:39.189020 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6f6d103-0952-4d39-a4a3-7029799ebfe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:39.189986 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6f6d103-0952-4d39-a4a3-7029799ebfe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:39.190444 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6f6d103-0952-4d39-a4a3-7029799ebfe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:39.190870 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d6f6d103-0952-4d39-a4a3-7029799ebfe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:39.406733 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d6f6d103-0952-4d39-a4a3-7029799ebfe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:39.415096 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d6f6d103-0952-4d39-a4a3-7029799ebfe6 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1576 microversion: 2.1 time: 0.237907 Aug 05 02:31:39.415667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 588/1176] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:39 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1576 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:40.436558 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5297d1e7-9d89-4314-b164-cc228e8e72a9 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:40.437862 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5297d1e7-9d89-4314-b164-cc228e8e72a9 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:40.449258 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5297d1e7-9d89-4314-b164-cc228e8e72a9 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:40.456021 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5297d1e7-9d89-4314-b164-cc228e8e72a9 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:40.457598 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5297d1e7-9d89-4314-b164-cc228e8e72a9 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:40.459481 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5297d1e7-9d89-4314-b164-cc228e8e72a9 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:40.459960 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5297d1e7-9d89-4314-b164-cc228e8e72a9 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:40.460450 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5297d1e7-9d89-4314-b164-cc228e8e72a9 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:40.671217 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5297d1e7-9d89-4314-b164-cc228e8e72a9 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:40.680368 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5297d1e7-9d89-4314-b164-cc228e8e72a9 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1576 microversion: 2.1 time: 0.247677 Aug 05 02:31:40.680952 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 589/1177] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:40 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1576 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:41.702365 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0795332a-a639-460c-885c-227b519e1971 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:41.702982 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0795332a-a639-460c-885c-227b519e1971 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:41.710802 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0795332a-a639-460c-885c-227b519e1971 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:41.711287 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0795332a-a639-460c-885c-227b519e1971 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:41.711810 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0795332a-a639-460c-885c-227b519e1971 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:41.712837 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0795332a-a639-460c-885c-227b519e1971 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:41.713288 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0795332a-a639-460c-885c-227b519e1971 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:41.713715 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0795332a-a639-460c-885c-227b519e1971 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:41.856696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0795332a-a639-460c-885c-227b519e1971 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:41.866136 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0795332a-a639-460c-885c-227b519e1971 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1576 microversion: 2.1 time: 0.167465 Aug 05 02:31:41.866713 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 589/1178] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:41 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:42.886909 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5b6fea7b-cc24-4cf5-b14e-8ac45327ea34 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:42.887598 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5b6fea7b-cc24-4cf5-b14e-8ac45327ea34 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:42.894472 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b6fea7b-cc24-4cf5-b14e-8ac45327ea34 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:42.895027 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b6fea7b-cc24-4cf5-b14e-8ac45327ea34 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:42.895550 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b6fea7b-cc24-4cf5-b14e-8ac45327ea34 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:42.896304 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b6fea7b-cc24-4cf5-b14e-8ac45327ea34 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:42.896848 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b6fea7b-cc24-4cf5-b14e-8ac45327ea34 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:42.897363 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5b6fea7b-cc24-4cf5-b14e-8ac45327ea34 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:43.036477 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5b6fea7b-cc24-4cf5-b14e-8ac45327ea34 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:43.044241 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5b6fea7b-cc24-4cf5-b14e-8ac45327ea34 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1576 microversion: 2.1 time: 0.161204 Aug 05 02:31:43.044854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 590/1179] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:42 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:44.067407 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bcad4510-b14c-475d-a509-a55a511c45d0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:44.068417 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bcad4510-b14c-475d-a509-a55a511c45d0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:44.078259 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcad4510-b14c-475d-a509-a55a511c45d0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:44.078712 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcad4510-b14c-475d-a509-a55a511c45d0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:44.079183 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcad4510-b14c-475d-a509-a55a511c45d0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:44.080746 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcad4510-b14c-475d-a509-a55a511c45d0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:44.081543 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcad4510-b14c-475d-a509-a55a511c45d0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:44.082010 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcad4510-b14c-475d-a509-a55a511c45d0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:44.228405 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bcad4510-b14c-475d-a509-a55a511c45d0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:44.237144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bcad4510-b14c-475d-a509-a55a511c45d0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1576 microversion: 2.1 time: 0.173734 Aug 05 02:31:44.251748 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 590/1180] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:44 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:45.258933 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b7ac0954-eae3-4c9c-aacc-a5a2a53f2007 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:45.259564 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b7ac0954-eae3-4c9c-aacc-a5a2a53f2007 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:45.266085 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b7ac0954-eae3-4c9c-aacc-a5a2a53f2007 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:45.266616 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b7ac0954-eae3-4c9c-aacc-a5a2a53f2007 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:45.267189 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b7ac0954-eae3-4c9c-aacc-a5a2a53f2007 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:45.267751 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b7ac0954-eae3-4c9c-aacc-a5a2a53f2007 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:45.268408 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b7ac0954-eae3-4c9c-aacc-a5a2a53f2007 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:45.268840 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b7ac0954-eae3-4c9c-aacc-a5a2a53f2007 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:45.410210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b7ac0954-eae3-4c9c-aacc-a5a2a53f2007 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:45.420813 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b7ac0954-eae3-4c9c-aacc-a5a2a53f2007 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1576 microversion: 2.1 time: 0.165516 Aug 05 02:31:45.421644 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 591/1181] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:45 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:46.444289 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e61edf69-28c6-4a6d-9d65-09f8259c8b29 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:46.445142 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e61edf69-28c6-4a6d-9d65-09f8259c8b29 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:46.451337 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e61edf69-28c6-4a6d-9d65-09f8259c8b29 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:46.451818 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e61edf69-28c6-4a6d-9d65-09f8259c8b29 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:46.452253 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e61edf69-28c6-4a6d-9d65-09f8259c8b29 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:46.452966 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e61edf69-28c6-4a6d-9d65-09f8259c8b29 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:46.453419 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e61edf69-28c6-4a6d-9d65-09f8259c8b29 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:46.453845 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e61edf69-28c6-4a6d-9d65-09f8259c8b29 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:46.590767 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e61edf69-28c6-4a6d-9d65-09f8259c8b29 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:46.599068 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e61edf69-28c6-4a6d-9d65-09f8259c8b29 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1576 microversion: 2.1 time: 0.159622 Aug 05 02:31:46.599642 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 591/1182] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:46 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:47.527964 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-bb0f949e-1a46-4ccc-9216-27ba59a0194b req-941f8eac-ac8a-4ac7-bab7-cb99f2c0ea0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb56ea7-8771-41b9-b537-a6d4afeda7ab", "name": "network-vif-plugged", "status": "completed", "tag": "652b8180-4f83-4880-81b9-b44df98605a9"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:31:47.537795 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-bb0f949e-1a46-4ccc-9216-27ba59a0194b req-941f8eac-ac8a-4ac7-bab7-cb99f2c0ea0b service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:47.538259 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-bb0f949e-1a46-4ccc-9216-27ba59a0194b req-941f8eac-ac8a-4ac7-bab7-cb99f2c0ea0b service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:47.538695 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-bb0f949e-1a46-4ccc-9216-27ba59a0194b req-941f8eac-ac8a-4ac7-bab7-cb99f2c0ea0b service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:47.549646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-bb0f949e-1a46-4ccc-9216-27ba59a0194b req-941f8eac-ac8a-4ac7-bab7-cb99f2c0ea0b service nova] Creating event network-vif-plugged:652b8180-4f83-4880-81b9-b44df98605a9 for instance 5eb56ea7-8771-41b9-b537-a6d4afeda7ab on hv-cinder-81558 Aug 05 02:31:47.554509 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-bb0f949e-1a46-4ccc-9216-27ba59a0194b req-941f8eac-ac8a-4ac7-bab7-cb99f2c0ea0b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152382 Aug 05 02:31:47.555071 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 592/1183] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:31:47.620218 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e0fa90ed-64b2-4ee4-9071-fc514225c0c5 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:47.620870 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e0fa90ed-64b2-4ee4-9071-fc514225c0c5 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:47.627294 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0fa90ed-64b2-4ee4-9071-fc514225c0c5 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:47.627775 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0fa90ed-64b2-4ee4-9071-fc514225c0c5 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:47.628213 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0fa90ed-64b2-4ee4-9071-fc514225c0c5 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:47.628937 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0fa90ed-64b2-4ee4-9071-fc514225c0c5 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:47.629568 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0fa90ed-64b2-4ee4-9071-fc514225c0c5 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:47.630023 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e0fa90ed-64b2-4ee4-9071-fc514225c0c5 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:47.769947 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e0fa90ed-64b2-4ee4-9071-fc514225c0c5 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:47.778371 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e0fa90ed-64b2-4ee4-9071-fc514225c0c5 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1576 microversion: 2.1 time: 0.162047 Aug 05 02:31:47.778949 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 592/1184] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:47 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:48.199450 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3161cbea-3555-451d-a6cc-dd6dc2b29d73 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:48.201879 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3161cbea-3555-451d-a6cc-dd6dc2b29d73 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:48.208153 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3161cbea-3555-451d-a6cc-dd6dc2b29d73 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:48.208622 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3161cbea-3555-451d-a6cc-dd6dc2b29d73 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:48.209059 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3161cbea-3555-451d-a6cc-dd6dc2b29d73 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:48.209797 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3161cbea-3555-451d-a6cc-dd6dc2b29d73 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:48.210240 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3161cbea-3555-451d-a6cc-dd6dc2b29d73 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:48.210665 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3161cbea-3555-451d-a6cc-dd6dc2b29d73 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:48.235412 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:48.240603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3161cbea-3555-451d-a6cc-dd6dc2b29d73 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045709 Aug 05 02:31:48.241164 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 593/1185] 10.222.0.15 () {60 vars in 1343 bytes} [Fri Aug 5 02:31:48 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:48.305674 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2dc85a12-b6f7-41ef-97c3-43f0401b7a2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:48.306202 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2dc85a12-b6f7-41ef-97c3-43f0401b7a2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:48.313474 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2dc85a12-b6f7-41ef-97c3-43f0401b7a2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:48.313943 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2dc85a12-b6f7-41ef-97c3-43f0401b7a2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:48.315129 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2dc85a12-b6f7-41ef-97c3-43f0401b7a2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:48.315842 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2dc85a12-b6f7-41ef-97c3-43f0401b7a2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:48.316340 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2dc85a12-b6f7-41ef-97c3-43f0401b7a2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:48.316952 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2dc85a12-b6f7-41ef-97c3-43f0401b7a2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:48.342967 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2dc85a12-b6f7-41ef-97c3-43f0401b7a2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:31:48.422677 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2dc85a12-b6f7-41ef-97c3-43f0401b7a2e tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 204 len: 0 microversion: 2.20 time: 0.120887 Aug 05 02:31:48.423288 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 593/1186] 10.222.0.15 () {60 vars in 1280 bytes} [Fri Aug 5 02:31:48 2022] DELETE /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 05 02:31:48.432677 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b1bd8e9b-3034-4ca6-9a6f-7b54de6546fe tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:48.433273 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-b1bd8e9b-3034-4ca6-9a6f-7b54de6546fe tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:48.440994 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b1bd8e9b-3034-4ca6-9a6f-7b54de6546fe tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:48.441472 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b1bd8e9b-3034-4ca6-9a6f-7b54de6546fe tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:48.441902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b1bd8e9b-3034-4ca6-9a6f-7b54de6546fe tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:48.442587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b1bd8e9b-3034-4ca6-9a6f-7b54de6546fe tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:48.443037 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b1bd8e9b-3034-4ca6-9a6f-7b54de6546fe tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:48.443455 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-b1bd8e9b-3034-4ca6-9a6f-7b54de6546fe tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:48.580003 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b1bd8e9b-3034-4ca6-9a6f-7b54de6546fe tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:48.588868 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b1bd8e9b-3034-4ca6-9a6f-7b54de6546fe tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:48.590474 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-b1bd8e9b-3034-4ca6-9a6f-7b54de6546fe tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:48.591755 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b1bd8e9b-3034-4ca6-9a6f-7b54de6546fe tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.163631 Aug 05 02:31:48.592410 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 594/1187] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:31:48 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:31:48.801414 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bb548a50-a769-420c-9b37-9566ab6aba90 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:48.802237 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bb548a50-a769-420c-9b37-9566ab6aba90 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:48.808508 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb548a50-a769-420c-9b37-9566ab6aba90 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:48.808981 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb548a50-a769-420c-9b37-9566ab6aba90 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:48.809411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb548a50-a769-420c-9b37-9566ab6aba90 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:48.810086 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb548a50-a769-420c-9b37-9566ab6aba90 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:48.810532 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb548a50-a769-420c-9b37-9566ab6aba90 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:48.810973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bb548a50-a769-420c-9b37-9566ab6aba90 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:48.948094 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bb548a50-a769-420c-9b37-9566ab6aba90 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:48.956192 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bb548a50-a769-420c-9b37-9566ab6aba90 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1576 microversion: 2.1 time: 0.159000 Aug 05 02:31:48.956799 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 594/1188] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:48 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:31:49.615028 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-47bcd7f0-f84c-43e8-b0b8-8fe99ff1fee5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:49.615641 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-47bcd7f0-f84c-43e8-b0b8-8fe99ff1fee5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:49.622057 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47bcd7f0-f84c-43e8-b0b8-8fe99ff1fee5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:49.622535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47bcd7f0-f84c-43e8-b0b8-8fe99ff1fee5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:49.622969 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47bcd7f0-f84c-43e8-b0b8-8fe99ff1fee5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:49.623650 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47bcd7f0-f84c-43e8-b0b8-8fe99ff1fee5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:49.624101 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47bcd7f0-f84c-43e8-b0b8-8fe99ff1fee5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:49.624558 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-47bcd7f0-f84c-43e8-b0b8-8fe99ff1fee5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:49.756135 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-47bcd7f0-f84c-43e8-b0b8-8fe99ff1fee5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:49.763967 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-47bcd7f0-f84c-43e8-b0b8-8fe99ff1fee5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:49.765500 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-47bcd7f0-f84c-43e8-b0b8-8fe99ff1fee5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:49.766649 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-47bcd7f0-f84c-43e8-b0b8-8fe99ff1fee5 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.155553 Aug 05 02:31:49.767776 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 595/1189] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:31:49 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:31:49.979109 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-be46500e-525d-4218-8a7c-46098708b4b0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:49.980126 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-be46500e-525d-4218-8a7c-46098708b4b0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:49.988843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be46500e-525d-4218-8a7c-46098708b4b0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:49.989500 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be46500e-525d-4218-8a7c-46098708b4b0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:49.990199 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be46500e-525d-4218-8a7c-46098708b4b0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:49.991275 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be46500e-525d-4218-8a7c-46098708b4b0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:49.991915 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be46500e-525d-4218-8a7c-46098708b4b0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:49.992557 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be46500e-525d-4218-8a7c-46098708b4b0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:50.416565 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-be46500e-525d-4218-8a7c-46098708b4b0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:50.425686 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-be46500e-525d-4218-8a7c-46098708b4b0 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1576 microversion: 2.1 time: 0.450299 Aug 05 02:31:50.426355 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 595/1190] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:49 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1576 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:50.789196 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-5a90eb2a-84bd-4cdd-91f4-d462cb9a9bdb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:50.789806 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-5a90eb2a-84bd-4cdd-91f4-d462cb9a9bdb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:50.796137 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a90eb2a-84bd-4cdd-91f4-d462cb9a9bdb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:50.796649 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a90eb2a-84bd-4cdd-91f4-d462cb9a9bdb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:50.797085 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a90eb2a-84bd-4cdd-91f4-d462cb9a9bdb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:50.797774 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a90eb2a-84bd-4cdd-91f4-d462cb9a9bdb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:50.798227 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a90eb2a-84bd-4cdd-91f4-d462cb9a9bdb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:50.799212 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-5a90eb2a-84bd-4cdd-91f4-d462cb9a9bdb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:51.026063 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5a90eb2a-84bd-4cdd-91f4-d462cb9a9bdb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:51.035584 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5a90eb2a-84bd-4cdd-91f4-d462cb9a9bdb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:51.037282 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-5a90eb2a-84bd-4cdd-91f4-d462cb9a9bdb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:51.038660 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-5a90eb2a-84bd-4cdd-91f4-d462cb9a9bdb tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1723 microversion: 2.20 time: 0.253472 Aug 05 02:31:51.039220 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 596/1191] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:31:50 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:31:51.447412 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fbdda797-d58f-4ebe-ba86-7617ba4e3ba1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:51.448211 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fbdda797-d58f-4ebe-ba86-7617ba4e3ba1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:51.457177 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbdda797-d58f-4ebe-ba86-7617ba4e3ba1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:51.458997 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbdda797-d58f-4ebe-ba86-7617ba4e3ba1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:51.458997 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbdda797-d58f-4ebe-ba86-7617ba4e3ba1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:51.458997 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbdda797-d58f-4ebe-ba86-7617ba4e3ba1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:51.459335 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbdda797-d58f-4ebe-ba86-7617ba4e3ba1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:51.459635 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbdda797-d58f-4ebe-ba86-7617ba4e3ba1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:51.615269 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fbdda797-d58f-4ebe-ba86-7617ba4e3ba1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:51.623914 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fbdda797-d58f-4ebe-ba86-7617ba4e3ba1 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1563 microversion: 2.1 time: 0.180577 Aug 05 02:31:51.636899 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 596/1192] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:31:51 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1563 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:31:51.801214 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-cf43857a-2be7-4f99-971d-fd7620afaaab req-730b55ba-d62b-48de-98a0-b7d3dd0cf7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac84bba5-1a3a-4625-ad22-276df81d03a1", "name": "network-vif-deleted", "tag": "a68b1751-4c77-41ca-80e7-300bcc5e2f50"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:31:51.811396 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-cf43857a-2be7-4f99-971d-fd7620afaaab req-730b55ba-d62b-48de-98a0-b7d3dd0cf7b5 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:51.811865 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-cf43857a-2be7-4f99-971d-fd7620afaaab req-730b55ba-d62b-48de-98a0-b7d3dd0cf7b5 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:51.812287 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-cf43857a-2be7-4f99-971d-fd7620afaaab req-730b55ba-d62b-48de-98a0-b7d3dd0cf7b5 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:51.839661 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-cf43857a-2be7-4f99-971d-fd7620afaaab req-730b55ba-d62b-48de-98a0-b7d3dd0cf7b5 service nova] Creating event network-vif-deleted:a68b1751-4c77-41ca-80e7-300bcc5e2f50 for instance ac84bba5-1a3a-4625-ad22-276df81d03a1 on hv-cinder-81558 Aug 05 02:31:51.849005 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-cf43857a-2be7-4f99-971d-fd7620afaaab req-730b55ba-d62b-48de-98a0-b7d3dd0cf7b5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051681 Aug 05 02:31:51.849677 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 597/1193] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:31:52.063301 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fe0e5439-fd39-41ab-af9f-13ee3e47527f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:52.063971 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fe0e5439-fd39-41ab-af9f-13ee3e47527f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:52.070532 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0e5439-fd39-41ab-af9f-13ee3e47527f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:52.071337 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0e5439-fd39-41ab-af9f-13ee3e47527f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:52.071842 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0e5439-fd39-41ab-af9f-13ee3e47527f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:52.072658 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0e5439-fd39-41ab-af9f-13ee3e47527f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:52.073352 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0e5439-fd39-41ab-af9f-13ee3e47527f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:52.073849 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0e5439-fd39-41ab-af9f-13ee3e47527f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:52.078139 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:52.110575 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0e5439-fd39-41ab-af9f-13ee3e47527f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:52.112291 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0e5439-fd39-41ab-af9f-13ee3e47527f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:52.112837 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe0e5439-fd39-41ab-af9f-13ee3e47527f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:52.113363 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-fe0e5439-fd39-41ab-af9f-13ee3e47527f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lazy-loading 'fault' on Instance uuid ac84bba5-1a3a-4625-ad22-276df81d03a1 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 05 02:31:52.165242 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fe0e5439-fd39-41ab-af9f-13ee3e47527f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:52.181775 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fe0e5439-fd39-41ab-af9f-13ee3e47527f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:52.183483 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fe0e5439-fd39-41ab-af9f-13ee3e47527f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d47613c7085460da42e2179625b3f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6873a99b9878495895acb21ed2133bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:31:52.185355 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fe0e5439-fd39-41ab-af9f-13ee3e47527f tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 200 len: 1371 microversion: 2.20 time: 0.126093 Aug 05 02:31:52.186430 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 597/1194] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:31:52 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 1371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 05 02:31:53.210026 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-38bd6a97-5d4b-4fac-a215-acf8886e29f6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:53.210720 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-38bd6a97-5d4b-4fac-a215-acf8886e29f6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:53.217008 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38bd6a97-5d4b-4fac-a215-acf8886e29f6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:53.217453 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38bd6a97-5d4b-4fac-a215-acf8886e29f6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:53.217884 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38bd6a97-5d4b-4fac-a215-acf8886e29f6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:53.218574 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38bd6a97-5d4b-4fac-a215-acf8886e29f6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:53.219019 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38bd6a97-5d4b-4fac-a215-acf8886e29f6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:53.219444 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-38bd6a97-5d4b-4fac-a215-acf8886e29f6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:53.233196 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-38bd6a97-5d4b-4fac-a215-acf8886e29f6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] HTTP exception thrown: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-38bd6a97-5d4b-4fac-a215-acf8886e29f6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Request method failure captured: Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 HTTP/1.1 Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5yU91JkM-Df5Hrb2J07-uB9jkTSxGC1uczeZcx36j6-RIzeFC8WLrFLO0In7oklMjJU1K26Lznm4FbUDDBB3b6GV67yN6SNxxU9GE5hQGqZstgC3yoQPOXZY01ADRcq3IfXSN6V3mfa3h9YvPh5xrLa00LD7XBHXXTuZcxhnrcBoI Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: 6873a99b9878495895acb21ed2133bb6 Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:31:53.234856 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:31:53.236765 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6873a99b9878495895acb21ed2133bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6873a99b9878495895acb21ed2133bb6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6873a99b9878495895acb21ed2133bb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6873a99b9878495895acb21ed2133bb6"}]}] Aug 05 02:31:53.236765 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:31:53.236765 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 6873a99b9878495895acb21ed2133bb6 Aug 05 02:31:53.236765 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:31:53.236765 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeShelveTestJSON-1669462514-project Aug 05 02:31:53.236765 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:31:53.236765 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:31:53.236765 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 3d47613c7085460da42e2179625b3f16 Aug 05 02:31:53.236765 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1669462514-project Aug 05 02:31:53.236765 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:31:53.236765 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. Aug 05 02:31:53.236765 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': 'ac84bba5-1a3a-4625-ad22-276df81d03a1'} Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:31:53.237585 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. Aug 05 02:31:53.238921 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:53.240156 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-38bd6a97-5d4b-4fac-a215-acf8886e29f6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Returning 404 to user: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:31:53.240156 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-38bd6a97-5d4b-4fac-a215-acf8886e29f6 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 404 len: 111 microversion: 2.20 time: 0.031717 Aug 05 02:31:53.240156 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 598/1195] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:31:53 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 02:31:53.245387 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f51a34b2-73b6-45cb-badd-4c8feece0464 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '.version_select at 0x7fa65c811f70>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:53.263951 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f51a34b2-73b6-45cb-badd-4c8feece0464 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1926461712" status: 204 len: 0 microversion: 2.20 time: 0.022278 Aug 05 02:31:53.264459 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 598/1196] 10.222.0.15 () {60 vars in 1262 bytes} [Fri Aug 5 02:31:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1926461712 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 05 02:31:55.135573 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-45fef7e1-bc33-42b8-85e3-931680b8fe28 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:55.136102 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-45fef7e1-bc33-42b8-85e3-931680b8fe28 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:55.143517 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45fef7e1-bc33-42b8-85e3-931680b8fe28 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:55.143997 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45fef7e1-bc33-42b8-85e3-931680b8fe28 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:55.144458 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45fef7e1-bc33-42b8-85e3-931680b8fe28 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:55.145146 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45fef7e1-bc33-42b8-85e3-931680b8fe28 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:55.145596 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45fef7e1-bc33-42b8-85e3-931680b8fe28 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:55.146014 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-45fef7e1-bc33-42b8-85e3-931680b8fe28 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:55.160231 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-45fef7e1-bc33-42b8-85e3-931680b8fe28 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] HTTP exception thrown: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-45fef7e1-bc33-42b8-85e3-931680b8fe28 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Request method failure captured: Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 HTTP/1.1 Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5yU91JkM-Df5Hrb2J07-uB9jkTSxGC1uczeZcx36j6-RIzeFC8WLrFLO0In7oklMjJU1K26Lznm4FbUDDBB3b6GV67yN6SNxxU9GE5hQGqZstgC3yoQPOXZY01ADRcq3IfXSN6V3mfa3h9YvPh5xrLa00LD7XBHXXTuZcxhnrcBoI Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: 6873a99b9878495895acb21ed2133bb6 Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:31:55.161794 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:31:55.164601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6873a99b9878495895acb21ed2133bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6873a99b9878495895acb21ed2133bb6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6873a99b9878495895acb21ed2133bb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6873a99b9878495895acb21ed2133bb6"}]}] Aug 05 02:31:55.164601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:31:55.164601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 6873a99b9878495895acb21ed2133bb6 Aug 05 02:31:55.164601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:31:55.164601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeShelveTestJSON-1669462514-project Aug 05 02:31:55.164601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:31:55.164601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:31:55.164601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 3d47613c7085460da42e2179625b3f16 Aug 05 02:31:55.164601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1669462514-project Aug 05 02:31:55.164601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:31:55.164601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. Aug 05 02:31:55.164601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': 'ac84bba5-1a3a-4625-ad22-276df81d03a1'} Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:31:55.166587 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. Aug 05 02:31:55.170233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:55.173430 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-45fef7e1-bc33-42b8-85e3-931680b8fe28 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Returning 404 to user: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:31:55.173430 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-45fef7e1-bc33-42b8-85e3-931680b8fe28 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 404 len: 111 microversion: 2.20 time: 0.031509 Aug 05 02:31:55.173430 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 599/1197] 10.222.0.15 () {60 vars in 1280 bytes} [Fri Aug 5 02:31:55 2022] DELETE /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 02:31:55.174241 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4de3f044-f9d8-4981-a535-8dd8bc3a83e9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:55.174860 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4de3f044-f9d8-4981-a535-8dd8bc3a83e9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: ac84bba5-1a3a-4625-ad22-276df81d03a1] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:55.181366 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4de3f044-f9d8-4981-a535-8dd8bc3a83e9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:55.181845 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4de3f044-f9d8-4981-a535-8dd8bc3a83e9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:55.182298 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4de3f044-f9d8-4981-a535-8dd8bc3a83e9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:55.182971 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4de3f044-f9d8-4981-a535-8dd8bc3a83e9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:55.183420 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4de3f044-f9d8-4981-a535-8dd8bc3a83e9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:55.183844 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4de3f044-f9d8-4981-a535-8dd8bc3a83e9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:55.197832 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-4de3f044-f9d8-4981-a535-8dd8bc3a83e9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] HTTP exception thrown: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4de3f044-f9d8-4981-a535-8dd8bc3a83e9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Request method failure captured: Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 HTTP/1.1 Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5yU91JkM-Df5Hrb2J07-uB9jkTSxGC1uczeZcx36j6-RIzeFC8WLrFLO0In7oklMjJU1K26Lznm4FbUDDBB3b6GV67yN6SNxxU9GE5hQGqZstgC3yoQPOXZY01ADRcq3IfXSN6V3mfa3h9YvPh5xrLa00LD7XBHXXTuZcxhnrcBoI Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 6873a99b9878495895acb21ed2133bb6 Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:31:55.199484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:31:55.201191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6873a99b9878495895acb21ed2133bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6873a99b9878495895acb21ed2133bb6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6873a99b9878495895acb21ed2133bb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6873a99b9878495895acb21ed2133bb6"}]}] Aug 05 02:31:55.201191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:31:55.201191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 6873a99b9878495895acb21ed2133bb6 Aug 05 02:31:55.201191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:31:55.201191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-1669462514-project Aug 05 02:31:55.201191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:31:55.201191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:31:55.201191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 3d47613c7085460da42e2179625b3f16 Aug 05 02:31:55.201191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1669462514-project Aug 05 02:31:55.201191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:31:55.201191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. Aug 05 02:31:55.201191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': 'ac84bba5-1a3a-4625-ad22-276df81d03a1'} Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:31:55.202167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. Aug 05 02:31:55.203667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:55.206299 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4de3f044-f9d8-4981-a535-8dd8bc3a83e9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Returning 404 to user: Instance ac84bba5-1a3a-4625-ad22-276df81d03a1 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:31:55.206299 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4de3f044-f9d8-4981-a535-8dd8bc3a83e9 tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1" status: 404 len: 111 microversion: 2.20 time: 0.031780 Aug 05 02:31:55.206299 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 599/1198] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:31:55 2022] GET /compute/v2.1/servers/ac84bba5-1a3a-4625-ad22-276df81d03a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 05 02:31:56.336840 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f7aaab0a-a845-49c3-b7e0-623ebe0d4a7a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:56.337590 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f7aaab0a-a845-49c3-b7e0-623ebe0d4a7a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:56.343753 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7aaab0a-a845-49c3-b7e0-623ebe0d4a7a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:56.344227 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7aaab0a-a845-49c3-b7e0-623ebe0d4a7a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:56.344692 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7aaab0a-a845-49c3-b7e0-623ebe0d4a7a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:56.346080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7aaab0a-a845-49c3-b7e0-623ebe0d4a7a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:56.346713 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7aaab0a-a845-49c3-b7e0-623ebe0d4a7a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:56.347131 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f7aaab0a-a845-49c3-b7e0-623ebe0d4a7a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:56.360163 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-f7aaab0a-a845-49c3-b7e0-623ebe0d4a7a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] HTTP exception thrown: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f7aaab0a-a845-49c3-b7e0-623ebe0d4a7a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Request method failure captured: Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab HTTP/1.1 Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7H5yU91JkM-Df5Hrb2J07-uB9jkTSxGC1uczeZcx36j6-RIzeFC8WLrFLO0In7oklMjJU1K26Lznm4FbUDDBB3b6GV67yN6SNxxU9GE5hQGqZstgC3yoQPOXZY01ADRcq3IfXSN6V3mfa3h9YvPh5xrLa00LD7XBHXXTuZcxhnrcBoI Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: 6873a99b9878495895acb21ed2133bb6 Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:31:56.361920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:31:56.363646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6873a99b9878495895acb21ed2133bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6873a99b9878495895acb21ed2133bb6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6873a99b9878495895acb21ed2133bb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6873a99b9878495895acb21ed2133bb6"}]}] Aug 05 02:31:56.363646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:31:56.363646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 6873a99b9878495895acb21ed2133bb6 Aug 05 02:31:56.363646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:31:56.363646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-AttachVolumeShelveTestJSON-1669462514-project Aug 05 02:31:56.363646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:31:56.363646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:31:56.363646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 3d47613c7085460da42e2179625b3f16 Aug 05 02:31:56.363646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1669462514-project Aug 05 02:31:56.363646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:31:56.363646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. Aug 05 02:31:56.363646 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': '319a8a64-7b50-4fff-93b6-4498b53265ab'} Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:31:56.364597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. Aug 05 02:31:56.366108 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:31:56.367558 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f7aaab0a-a845-49c3-b7e0-623ebe0d4a7a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Returning 404 to user: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:31:56.367558 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f7aaab0a-a845-49c3-b7e0-623ebe0d4a7a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "DELETE /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 404 len: 111 microversion: 2.20 time: 0.030331 Aug 05 02:31:56.367558 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 600/1199] 10.222.0.15 () {60 vars in 1280 bytes} [Fri Aug 5 02:31:56 2022] DELETE /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 05 02:31:56.371696 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ab27aba6-2ef9-49b4-a146-75da272e198a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:31:56.372304 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ab27aba6-2ef9-49b4-a146-75da272e198a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] [instance: 319a8a64-7b50-4fff-93b6-4498b53265ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:31:56.378144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab27aba6-2ef9-49b4-a146-75da272e198a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:56.378620 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab27aba6-2ef9-49b4-a146-75da272e198a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:56.379052 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab27aba6-2ef9-49b4-a146-75da272e198a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:56.379729 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab27aba6-2ef9-49b4-a146-75da272e198a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:31:56.380174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab27aba6-2ef9-49b4-a146-75da272e198a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:31:56.380621 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ab27aba6-2ef9-49b4-a146-75da272e198a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:31:56.394068 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-ab27aba6-2ef9-49b4-a146-75da272e198a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] HTTP exception thrown: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ab27aba6-2ef9-49b4-a146-75da272e198a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Request method failure captured: Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab HTTP/1.1 Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7H5yU91JkM-Df5Hrb2J07-uB9jkTSxGC1uczeZcx36j6-RIzeFC8WLrFLO0In7oklMjJU1K26Lznm4FbUDDBB3b6GV67yN6SNxxU9GE5hQGqZstgC3yoQPOXZY01ADRcq3IfXSN6V3mfa3h9YvPh5xrLa00LD7XBHXXTuZcxhnrcBoI Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 6873a99b9878495895acb21ed2133bb6 Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:31:56.395555 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:31:56.397248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6873a99b9878495895acb21ed2133bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6873a99b9878495895acb21ed2133bb6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6873a99b9878495895acb21ed2133bb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6873a99b9878495895acb21ed2133bb6"}]}] Aug 05 02:31:56.397248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:31:56.397248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 6873a99b9878495895acb21ed2133bb6 Aug 05 02:31:56.397248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1669462514 Aug 05 02:31:56.397248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-1669462514-project Aug 05 02:31:56.397248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:31:56.397248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:31:56.397248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 3d47613c7085460da42e2179625b3f16 Aug 05 02:31:56.397248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1669462514-project Aug 05 02:31:56.397248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:31:56.397248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. Aug 05 02:31:56.397248 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '319a8a64-7b50-4fff-93b6-4498b53265ab'} Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:31:56.398328 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. Aug 05 02:31:56.399850 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:31:56.401245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ab27aba6-2ef9-49b4-a146-75da272e198a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] Returning 404 to user: Instance 319a8a64-7b50-4fff-93b6-4498b53265ab could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:31:56.401245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ab27aba6-2ef9-49b4-a146-75da272e198a tempest-AttachVolumeShelveTestJSON-1669462514 tempest-AttachVolumeShelveTestJSON-1669462514-project] 10.222.0.15 "GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab" status: 404 len: 111 microversion: 2.20 time: 0.029243 Aug 05 02:31:56.401245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 600/1200] 10.222.0.15 () {60 vars in 1277 bytes} [Fri Aug 5 02:31:56 2022] GET /compute/v2.1/servers/319a8a64-7b50-4fff-93b6-4498b53265ab => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 05 02:32:00.565851 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1ed50cd5-fd3e-46a2-b2b5-c45e89fc8952 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Action: 'create', calling method: .version_select at 0x7fa65c605d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-990622490"}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:32:00.871669 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1ed50cd5-fd3e-46a2-b2b5-c45e89fc8952 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.433295 Aug 05 02:32:00.872672 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 601/1201] 10.222.0.15 () {60 vars in 1155 bytes} [Fri Aug 5 02:32:00 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 435 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 05 02:32:00.885068 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5a77474a-f094-45ad-936c-e26702329536 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa65c7db790>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:00.935174 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5a77474a-f094-45ad-936c-e26702329536 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19" status: 200 len: 344 microversion: 2.1 time: 0.053839 Aug 05 02:32:00.935736 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 601/1202] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Aug 5 02:32:00 2022] GET /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:32:01.951712 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b1d32d9d-e125-4ff7-b540-0d02a86f2c83 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa660e0f3a0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:02.003040 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b1d32d9d-e125-4ff7-b540-0d02a86f2c83 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19" status: 200 len: 345 microversion: 2.1 time: 0.055852 Aug 05 02:32:02.003607 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 602/1203] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Aug 5 02:32:01 2022] GET /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:32:02.017816 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-87576e8c-c347-402c-b4e6-becd0c97d61c tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Action: 'create', calling method: .version_select at 0x7fa65c66c790>, body: {"snapshot": {"volume_id": "19f793f1-0416-4837-94c5-aa4e4bf6ac19", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1769711758"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:32:02.170790 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-87576e8c-c347-402c-b4e6-becd0c97d61c tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.158784 Aug 05 02:32:02.171545 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 602/1204] 10.222.0.15 () {60 vars in 1162 bytes} [Fri Aug 5 02:32:02 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:32:02.182036 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-17689368-1177-4a66-81c0-4cd348ecdbf8 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa65c7250d0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:02.214541 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-17689368-1177-4a66-81c0-4cd348ecdbf8 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf" status: 200 len: 287 microversion: 2.1 time: 0.036151 Aug 05 02:32:02.215093 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 603/1205] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Aug 5 02:32:02 2022] GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:32:02.228309 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-048a0769-3cbb-45d3-9021-3a5fac9c0107 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa65c7e1670>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:02.258582 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-048a0769-3cbb-45d3-9021-3a5fac9c0107 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034742 Aug 05 02:32:02.259138 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 603/1206] 10.222.0.15 () {58 vars in 1140 bytes} [Fri Aug 5 02:32:02 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:32:02.270733 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-b75b4463-fc8c-491f-ac9e-215003e65703 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa660eea5e0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:02.302872 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-b75b4463-fc8c-491f-ac9e-215003e65703 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf" status: 200 len: 287 microversion: 2.1 time: 0.036818 Aug 05 02:32:02.303429 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 604/1207] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Aug 5 02:32:02 2022] GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:32:03.315735 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-72a804f2-0727-4ab2-9dc0-0338f253d623 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa65c7dbf70>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:03.346935 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-72a804f2-0727-4ab2-9dc0-0338f253d623 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf" status: 200 len: 287 microversion: 2.1 time: 0.035519 Aug 05 02:32:03.347493 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 604/1208] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Aug 5 02:32:03 2022] GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:32:04.359398 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-db86f2a6-b4d6-4e7c-aebd-548abb904300 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa65c6054c0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:04.389498 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-db86f2a6-b4d6-4e7c-aebd-548abb904300 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf" status: 200 len: 287 microversion: 2.1 time: 0.034310 Aug 05 02:32:04.390175 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 605/1209] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Aug 5 02:32:04 2022] GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:32:05.402918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cdb74374-8999-4122-98de-0df25bc326c9 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa65c657670>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:05.432851 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cdb74374-8999-4122-98de-0df25bc326c9 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf" status: 200 len: 287 microversion: 2.1 time: 0.034272 Aug 05 02:32:05.433399 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 605/1210] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Aug 5 02:32:05 2022] GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:32:06.443042 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=31 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:06.443805 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=26 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:06.448021 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ad0693b9-1c6e-42b5-9f38-1d6d8b4081a6 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa65c566af0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:06.479413 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ad0693b9-1c6e-42b5-9f38-1d6d8b4081a6 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf" status: 200 len: 288 microversion: 2.1 time: 0.037598 Aug 05 02:32:06.480041 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 606/1211] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Aug 5 02:32:06 2022] GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:32:06.488018 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:06.488804 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=10 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:06.493236 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a8c23397-e11b-478d-a604-d98001326ecb tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa65c6e0940>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:06.554940 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a8c23397-e11b-478d-a604-d98001326ecb tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf" status: 202 len: 0 microversion: 2.1 time: 0.067535 Aug 05 02:32:06.555508 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 606/1212] 10.222.0.15 () {58 vars in 1254 bytes} [Fri Aug 5 02:32:06 2022] DELETE /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:32:06.564250 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f4109a98-d9cf-4341-be78-9d7e85f22fd1 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa65c605a60>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:06.593397 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f4109a98-d9cf-4341-be78-9d7e85f22fd1 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf" status: 200 len: 287 microversion: 2.1 time: 0.033434 Aug 05 02:32:06.593950 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 607/1213] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Aug 5 02:32:06 2022] GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:32:07.606756 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b01dac12-0773-4169-8925-7f4db53a632e tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa65c811430>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:07.635659 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-b01dac12-0773-4169-8925-7f4db53a632e tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] HTTP exception thrown: Snapshot 7a0db8af-a771-412d-bcaf-dc9b3a150bcf could not be found. Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b01dac12-0773-4169-8925-7f4db53a632e tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Request method failure captured: Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf HTTP/1.1 Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7IEgnRupor2vKmcVq_UYTYw937P445vZzlRbG2s6_7S5nfEngIjvkuQPPT-mexXKji8vmlbqC8Hy1w-7szEBw9MqisNgRouMWMCsxfHTT7llo7ODTEoq98FbMy8SaBndqXxi_TYLmpnrU-j8RlfayuvE8VoSuGf7dk60zlDup7KScf4 Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: aa1ddae651ae43b8858dda78df091ee7 Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-282212337 Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:32:07.638478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:32:07.640152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/aa1ddae651ae43b8858dda78df091ee7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_aa1ddae651ae43b8858dda78df091ee7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/aa1ddae651ae43b8858dda78df091ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/aa1ddae651ae43b8858dda78df091ee7"}]}] Aug 05 02:32:07.640152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesSnapshotsTestJSON-282212337 Aug 05 02:32:07.640152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: aa1ddae651ae43b8858dda78df091ee7 Aug 05 02:32:07.640152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-282212337 Aug 05 02:32:07.640152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesSnapshotsTestJSON-282212337-project Aug 05 02:32:07.640152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:32:07.640152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:32:07.640152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: b44894dc37cb4461931fdb80745efc58 Aug 05 02:32:07.640152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesSnapshotsTestJSON-282212337-project Aug 05 02:32:07.640152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: Aug 05 02:32:07.640152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Snapshot 7a0db8af-a771-412d-bcaf-dc9b3a150bcf could not be found. Aug 05 02:32:07.640152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '7a0db8af-a771-412d-bcaf-dc9b3a150bcf'} Aug 05 02:32:07.640152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7a0db8af-a771-412d-bcaf-dc9b3a150bcf could not be found. (HTTP 404) (Request-ID: req-e7b8a1ad-7a98-450a-9f35-f02cceb4ba72) Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:32:07.641176 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 02:32:07.643428 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7a0db8af-a771-412d-bcaf-dc9b3a150bcf could not be found. Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 05 02:32:07.645120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:32:07.646598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7a0db8af-a771-412d-bcaf-dc9b3a150bcf could not be found. Aug 05 02:32:07.646598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:32:07.646598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:32:07.646598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:32:07.646598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:32:07.646598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:32:07.646598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:32:07.646598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:32:07.646598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:32:07.646598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7a0db8af-a771-412d-bcaf-dc9b3a150bcf could not be found. Aug 05 02:32:07.646598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:32:07.646598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b01dac12-0773-4169-8925-7f4db53a632e tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Returning 404 to user: Snapshot 7a0db8af-a771-412d-bcaf-dc9b3a150bcf could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:32:07.646598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b01dac12-0773-4169-8925-7f4db53a632e tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf" status: 404 len: 111 microversion: 2.1 time: 0.037578 Aug 05 02:32:07.647574 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 607/1214] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Aug 5 02:32:07 2022] GET /compute/v2.1/os-snapshots/7a0db8af-a771-412d-bcaf-dc9b3a150bcf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:32:07.650011 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a5cb138f-8a66-40e0-8002-9b2f1817134d tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa660e0f040>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:07.716270 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a5cb138f-8a66-40e0-8002-9b2f1817134d tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19" status: 202 len: 0 microversion: 2.1 time: 0.070640 Aug 05 02:32:07.716865 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 608/1215] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Aug 5 02:32:07 2022] DELETE /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 05 02:32:07.726033 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-72270490-bd81-4e33-8405-765d2743fd92 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa65c6e04c0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:07.775483 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-72270490-bd81-4e33-8405-765d2743fd92 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19" status: 200 len: 344 microversion: 2.1 time: 0.053332 Aug 05 02:32:07.776044 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 608/1216] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Aug 5 02:32:07 2022] GET /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:32:08.791235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8fa34d36-5b5f-4866-a23f-363e58ca5ef1 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa65c5661f0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:08.818552 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-8fa34d36-5b5f-4866-a23f-363e58ca5ef1 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] HTTP exception thrown: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8fa34d36-5b5f-4866-a23f-363e58ca5ef1 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Request method failure captured: Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19 HTTP/1.1 Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7IEgnRupor2vKmcVq_UYTYw937P445vZzlRbG2s6_7S5nfEngIjvkuQPPT-mexXKji8vmlbqC8Hy1w-7szEBw9MqisNgRouMWMCsxfHTT7llo7ODTEoq98FbMy8SaBndqXxi_TYLmpnrU-j8RlfayuvE8VoSuGf7dk60zlDup7KScf4 Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: aa1ddae651ae43b8858dda78df091ee7 Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-282212337 Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:32:08.820532 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:32:08.822130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/aa1ddae651ae43b8858dda78df091ee7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_aa1ddae651ae43b8858dda78df091ee7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/aa1ddae651ae43b8858dda78df091ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/aa1ddae651ae43b8858dda78df091ee7"}]}] Aug 05 02:32:08.822130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesSnapshotsTestJSON-282212337 Aug 05 02:32:08.822130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: aa1ddae651ae43b8858dda78df091ee7 Aug 05 02:32:08.822130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-282212337 Aug 05 02:32:08.822130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesSnapshotsTestJSON-282212337-project Aug 05 02:32:08.822130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:32:08.822130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:32:08.822130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: b44894dc37cb4461931fdb80745efc58 Aug 05 02:32:08.822130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesSnapshotsTestJSON-282212337-project Aug 05 02:32:08.822130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: Aug 05 02:32:08.822130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. Aug 05 02:32:08.822130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': '19f793f1-0416-4837-94c5-aa4e4bf6ac19'} Aug 05 02:32:08.822130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. (HTTP 404) (Request-ID: req-7a94195a-73ce-41bf-b905-4416c1ceac4b) Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:32:08.823065 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 02:32:08.824522 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 02:32:08.826048 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:32:08.827659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. Aug 05 02:32:08.827659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.827659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:32:08.827659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.827659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:32:08.827659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:32:08.827659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:32:08.827659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:32:08.827659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:32:08.827659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. Aug 05 02:32:08.827659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.827659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8fa34d36-5b5f-4866-a23f-363e58ca5ef1 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Returning 404 to user: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:32:08.827659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8fa34d36-5b5f-4866-a23f-363e58ca5ef1 tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19" status: 404 len: 109 microversion: 2.1 time: 0.035167 Aug 05 02:32:08.827659 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 609/1217] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Aug 5 02:32:08 2022] GET /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:32:08.836131 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4f0f0a80-5439-490c-b929-d26314a3974e tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa65c8cee50>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:08.865249 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-4f0f0a80-5439-490c-b929-d26314a3974e tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] HTTP exception thrown: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4f0f0a80-5439-490c-b929-d26314a3974e tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Request method failure captured: Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19 HTTP/1.1 Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7IEgnRupor2vKmcVq_UYTYw937P445vZzlRbG2s6_7S5nfEngIjvkuQPPT-mexXKji8vmlbqC8Hy1w-7szEBw9MqisNgRouMWMCsxfHTT7llo7ODTEoq98FbMy8SaBndqXxi_TYLmpnrU-j8RlfayuvE8VoSuGf7dk60zlDup7KScf4 Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: aa1ddae651ae43b8858dda78df091ee7 Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-282212337 Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:32:08.867163 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:32:08.868843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/aa1ddae651ae43b8858dda78df091ee7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_aa1ddae651ae43b8858dda78df091ee7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/aa1ddae651ae43b8858dda78df091ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/aa1ddae651ae43b8858dda78df091ee7"}]}] Aug 05 02:32:08.868843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesSnapshotsTestJSON-282212337 Aug 05 02:32:08.868843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: aa1ddae651ae43b8858dda78df091ee7 Aug 05 02:32:08.868843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-282212337 Aug 05 02:32:08.868843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesSnapshotsTestJSON-282212337-project Aug 05 02:32:08.868843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:32:08.868843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:32:08.868843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: b44894dc37cb4461931fdb80745efc58 Aug 05 02:32:08.868843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesSnapshotsTestJSON-282212337-project Aug 05 02:32:08.868843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: Aug 05 02:32:08.868843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. Aug 05 02:32:08.868843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '19f793f1-0416-4837-94c5-aa4e4bf6ac19'} Aug 05 02:32:08.868843 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. (HTTP 404) (Request-ID: req-213efde1-13c8-4bfd-b9e4-66270106beee) Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:32:08.869724 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 05 02:32:08.871509 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 05 02:32:08.873794 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:32:08.875617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. Aug 05 02:32:08.875617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.875617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:32:08.875617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.875617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:32:08.875617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:32:08.875617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:32:08.875617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:32:08.875617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:32:08.875617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. Aug 05 02:32:08.875617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.875617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4f0f0a80-5439-490c-b929-d26314a3974e tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Returning 404 to user: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:32:08.875617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4f0f0a80-5439-490c-b929-d26314a3974e tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19" status: 404 len: 109 microversion: 2.1 time: 0.036691 Aug 05 02:32:08.875617 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 609/1218] 10.222.0.15 () {58 vars in 1248 bytes} [Fri Aug 5 02:32:08 2022] DELETE /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:32:08.878233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ff8507e7-2d6d-45eb-8773-d05b81de1bbf tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Calling method '.version_select at 0x7fa660e0f670>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:32:08.906758 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-ff8507e7-2d6d-45eb-8773-d05b81de1bbf tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] HTTP exception thrown: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ff8507e7-2d6d-45eb-8773-d05b81de1bbf tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Request method failure captured: Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19 HTTP/1.1 Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7IEgnRupor2vKmcVq_UYTYw937P445vZzlRbG2s6_7S5nfEngIjvkuQPPT-mexXKji8vmlbqC8Hy1w-7szEBw9MqisNgRouMWMCsxfHTT7llo7ODTEoq98FbMy8SaBndqXxi_TYLmpnrU-j8RlfayuvE8VoSuGf7dk60zlDup7KScf4 Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: aa1ddae651ae43b8858dda78df091ee7 Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-282212337 Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:32:08.909254 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:32:08.910866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/aa1ddae651ae43b8858dda78df091ee7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_aa1ddae651ae43b8858dda78df091ee7", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/aa1ddae651ae43b8858dda78df091ee7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/aa1ddae651ae43b8858dda78df091ee7"}]}] Aug 05 02:32:08.910866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-VolumesSnapshotsTestJSON-282212337 Aug 05 02:32:08.910866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: aa1ddae651ae43b8858dda78df091ee7 Aug 05 02:32:08.910866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-282212337 Aug 05 02:32:08.910866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-VolumesSnapshotsTestJSON-282212337-project Aug 05 02:32:08.910866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:32:08.910866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:32:08.910866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: b44894dc37cb4461931fdb80745efc58 Aug 05 02:32:08.910866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-VolumesSnapshotsTestJSON-282212337-project Aug 05 02:32:08.910866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: Aug 05 02:32:08.910866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. Aug 05 02:32:08.910866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': '19f793f1-0416-4837-94c5-aa4e4bf6ac19'} Aug 05 02:32:08.910866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. (HTTP 404) (Request-ID: req-26446b55-44c2-4ea2-8f92-42cc9396f9d7) Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:32:08.911854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 05 02:32:08.913283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 05 02:32:08.914956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:32:08.916445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. Aug 05 02:32:08.916445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.916445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:32:08.916445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.916445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:32:08.916445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:32:08.916445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:32:08.916445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:32:08.916445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:32:08.916445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. Aug 05 02:32:08.916445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:32:08.916445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ff8507e7-2d6d-45eb-8773-d05b81de1bbf tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] Returning 404 to user: Volume 19f793f1-0416-4837-94c5-aa4e4bf6ac19 could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:32:08.916445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ff8507e7-2d6d-45eb-8773-d05b81de1bbf tempest-VolumesSnapshotsTestJSON-282212337 tempest-VolumesSnapshotsTestJSON-282212337-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19" status: 404 len: 109 microversion: 2.1 time: 0.036977 Aug 05 02:32:08.916445 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 610/1219] 10.222.0.15 () {58 vars in 1245 bytes} [Fri Aug 5 02:32:08 2022] GET /compute/v2.1/os-volumes/19f793f1-0416-4837-94c5-aa4e4bf6ac19 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:33:00.782073 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7ec0b97f-b9eb-4024-87de-dfb1458d77f4 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Action: 'create', calling method: .version_select at 0x7fa65c7d0280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-592323774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeaa7+iytgqfaWn8NBepaiRf5P2IcE41tqOu/sNA3GQdskhu6lb6na7amPTvIbRJo4W8x120nUITHQa3wmXyOCCjVIWLKy0FilDFjVq20XTNRzgADY5QUpJ99nxqe/ZQw=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:33:00.802325 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-7ec0b97f-b9eb-4024-87de-dfb1458d77f4 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Getting quotas for project 59a7ad5acdc34d0782e2c6807a4fd60f. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:33:00.806854 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-7ec0b97f-b9eb-4024-87de-dfb1458d77f4 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Getting quotas for user 5f163bd8d55e47019d7e7ef5ade78b38 and project 59a7ad5acdc34d0782e2c6807a4fd60f. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:33:00.830779 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7ec0b97f-b9eb-4024-87de-dfb1458d77f4 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.231075 Aug 05 02:33:00.831598 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 610/1220] 10.222.0.15 () {60 vars in 1159 bytes} [Fri Aug 5 02:33:00 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:33:29.914074 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1854907071", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-592323774", "security_groups": [{"name": "tempest-secgroup-smoke-561808126"}], "block_device_mapping_v2": [{"uuid": "19896e1e-75d8-4f03-8f85-1f1141b115a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9b4600cc-d12c-464b-9ce2-d2bcd950bd3f"}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:33:30.026073 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] validate_networks() for [('9b4600cc-d12c-464b-9ce2-d2bcd950bd3f', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:33:30.483149 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:33:30.483565 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:33:30.484029 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:33:30.484465 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:33:30.484870 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:33:30.493413 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:30.493881 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:30.494307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:30.495018 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:30.495458 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:30.495889 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:30.512251 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Getting quotas for project 59a7ad5acdc34d0782e2c6807a4fd60f. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:33:30.516042 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Getting quotas for user 5f163bd8d55e47019d7e7ef5ade78b38 and project 59a7ad5acdc34d0782e2c6807a4fd60f. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:33:30.571996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:33:30.574088 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='19896e1e-75d8-4f03-8f85-1f1141b115a1',volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:33:30.701589 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-bf34d7dd-054f-4c79-b8ad-cae2949bd5db tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.793088 Aug 05 02:33:30.702210 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 611/1221] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:33:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:33:30.710758 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:30.711505 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:30.715533 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d1a4716f-a98a-4ce7-836f-68ec34818556 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:30.716138 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d1a4716f-a98a-4ce7-836f-68ec34818556 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:30.775276 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d1a4716f-a98a-4ce7-836f-68ec34818556 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:30.781923 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d1a4716f-a98a-4ce7-836f-68ec34818556 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1094 microversion: 2.1 time: 0.072421 Aug 05 02:33:30.782488 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 611/1222] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:30 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:31.804291 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a3dbc543-96d8-43c5-bd2d-961a1268f62a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:31.805309 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a3dbc543-96d8-43c5-bd2d-961a1268f62a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:31.811586 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3dbc543-96d8-43c5-bd2d-961a1268f62a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:31.812132 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3dbc543-96d8-43c5-bd2d-961a1268f62a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:31.812687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3dbc543-96d8-43c5-bd2d-961a1268f62a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:31.813504 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3dbc543-96d8-43c5-bd2d-961a1268f62a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:31.814019 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3dbc543-96d8-43c5-bd2d-961a1268f62a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:31.814514 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a3dbc543-96d8-43c5-bd2d-961a1268f62a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:31.898045 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a3dbc543-96d8-43c5-bd2d-961a1268f62a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:31.906315 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a3dbc543-96d8-43c5-bd2d-961a1268f62a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1210 microversion: 2.1 time: 0.107073 Aug 05 02:33:31.906893 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 612/1223] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:31 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:32.928691 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8eaec103-17c0-46dc-b32a-350e81657e7e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:32.929411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8eaec103-17c0-46dc-b32a-350e81657e7e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:32.935963 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8eaec103-17c0-46dc-b32a-350e81657e7e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:32.936590 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8eaec103-17c0-46dc-b32a-350e81657e7e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:32.937090 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8eaec103-17c0-46dc-b32a-350e81657e7e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:32.939005 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8eaec103-17c0-46dc-b32a-350e81657e7e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:32.939460 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8eaec103-17c0-46dc-b32a-350e81657e7e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:32.939884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8eaec103-17c0-46dc-b32a-350e81657e7e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:33.045631 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-3f9fa923-c33b-4bc1-a525-44add3dec61e req-860ac41b-ba13-46b4-ba23-8a18bc63452d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d", "tag": "05c19a4c-fc1d-4eb9-b7d1-a74975263d45"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:33:33.057119 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-3f9fa923-c33b-4bc1-a525-44add3dec61e req-860ac41b-ba13-46b4-ba23-8a18bc63452d service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:33.057517 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-3f9fa923-c33b-4bc1-a525-44add3dec61e req-860ac41b-ba13-46b4-ba23-8a18bc63452d service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:33.058197 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-3f9fa923-c33b-4bc1-a525-44add3dec61e req-860ac41b-ba13-46b4-ba23-8a18bc63452d service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:33.070767 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-3f9fa923-c33b-4bc1-a525-44add3dec61e req-860ac41b-ba13-46b4-ba23-8a18bc63452d service nova] Creating event network-changed:05c19a4c-fc1d-4eb9-b7d1-a74975263d45 for instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d on hv-cinder-81558 Aug 05 02:33:33.075766 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-3f9fa923-c33b-4bc1-a525-44add3dec61e req-860ac41b-ba13-46b4-ba23-8a18bc63452d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033931 Aug 05 02:33:33.076601 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 613/1224] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:33:33.102096 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8eaec103-17c0-46dc-b32a-350e81657e7e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:33.109876 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8eaec103-17c0-46dc-b32a-350e81657e7e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1265 microversion: 2.1 time: 0.186211 Aug 05 02:33:33.110439 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 612/1225] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:32 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:34.132769 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a844b9e8-97f7-4a04-b74e-94585cd3373a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:34.133379 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a844b9e8-97f7-4a04-b74e-94585cd3373a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:34.139734 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a844b9e8-97f7-4a04-b74e-94585cd3373a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:34.140209 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a844b9e8-97f7-4a04-b74e-94585cd3373a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:34.140663 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a844b9e8-97f7-4a04-b74e-94585cd3373a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:34.141343 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a844b9e8-97f7-4a04-b74e-94585cd3373a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:34.141788 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a844b9e8-97f7-4a04-b74e-94585cd3373a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:34.142209 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a844b9e8-97f7-4a04-b74e-94585cd3373a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:34.270360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a844b9e8-97f7-4a04-b74e-94585cd3373a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:34.278371 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a844b9e8-97f7-4a04-b74e-94585cd3373a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1265 microversion: 2.1 time: 0.151070 Aug 05 02:33:34.278931 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 614/1226] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:34 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:35.298648 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3d0c2ae5-ebff-44e6-8a6a-4db873217e89 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:35.299196 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3d0c2ae5-ebff-44e6-8a6a-4db873217e89 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:35.306343 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d0c2ae5-ebff-44e6-8a6a-4db873217e89 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:35.306816 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d0c2ae5-ebff-44e6-8a6a-4db873217e89 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:35.307247 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d0c2ae5-ebff-44e6-8a6a-4db873217e89 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:35.307932 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d0c2ae5-ebff-44e6-8a6a-4db873217e89 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:35.308403 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d0c2ae5-ebff-44e6-8a6a-4db873217e89 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:35.308930 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3d0c2ae5-ebff-44e6-8a6a-4db873217e89 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:35.437672 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3d0c2ae5-ebff-44e6-8a6a-4db873217e89 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:35.446024 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3d0c2ae5-ebff-44e6-8a6a-4db873217e89 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1265 microversion: 2.1 time: 0.151287 Aug 05 02:33:35.446591 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 613/1227] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:35 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:36.466632 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4977d0b7-de9d-410e-a650-8108ef4a9cdb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:36.467235 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4977d0b7-de9d-410e-a650-8108ef4a9cdb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:36.473505 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4977d0b7-de9d-410e-a650-8108ef4a9cdb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:36.474027 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4977d0b7-de9d-410e-a650-8108ef4a9cdb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:36.474499 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4977d0b7-de9d-410e-a650-8108ef4a9cdb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:36.475176 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4977d0b7-de9d-410e-a650-8108ef4a9cdb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:36.475620 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4977d0b7-de9d-410e-a650-8108ef4a9cdb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:36.476036 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4977d0b7-de9d-410e-a650-8108ef4a9cdb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:36.606204 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4977d0b7-de9d-410e-a650-8108ef4a9cdb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:36.613508 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4977d0b7-de9d-410e-a650-8108ef4a9cdb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1265 microversion: 2.1 time: 0.150756 Aug 05 02:33:36.614059 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 615/1228] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:36 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:37.634881 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-658bb126-797c-4f33-86c4-1c0992eb7309 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:37.635594 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-658bb126-797c-4f33-86c4-1c0992eb7309 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:37.642200 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-658bb126-797c-4f33-86c4-1c0992eb7309 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:37.642676 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-658bb126-797c-4f33-86c4-1c0992eb7309 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:37.643102 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-658bb126-797c-4f33-86c4-1c0992eb7309 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:37.643795 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-658bb126-797c-4f33-86c4-1c0992eb7309 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:37.644241 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-658bb126-797c-4f33-86c4-1c0992eb7309 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:37.644690 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-658bb126-797c-4f33-86c4-1c0992eb7309 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:37.784351 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-658bb126-797c-4f33-86c4-1c0992eb7309 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:37.792178 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-658bb126-797c-4f33-86c4-1c0992eb7309 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1265 microversion: 2.1 time: 0.161759 Aug 05 02:33:37.792759 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 614/1229] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:37 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:38.813752 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-a4e500d1-71c5-448a-aef7-b16925163b4e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:38.814354 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-a4e500d1-71c5-448a-aef7-b16925163b4e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:38.821464 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a4e500d1-71c5-448a-aef7-b16925163b4e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:38.821934 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a4e500d1-71c5-448a-aef7-b16925163b4e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:38.822360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a4e500d1-71c5-448a-aef7-b16925163b4e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:38.823039 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a4e500d1-71c5-448a-aef7-b16925163b4e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:38.823479 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a4e500d1-71c5-448a-aef7-b16925163b4e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:38.823899 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-a4e500d1-71c5-448a-aef7-b16925163b4e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:38.954017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-a4e500d1-71c5-448a-aef7-b16925163b4e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:38.961772 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-a4e500d1-71c5-448a-aef7-b16925163b4e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1265 microversion: 2.1 time: 0.151999 Aug 05 02:33:38.962583 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 616/1230] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:38 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:39.982252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-00df7252-a58f-4964-a9c4-bca0372e7068 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:39.983102 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-00df7252-a58f-4964-a9c4-bca0372e7068 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:39.989396 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00df7252-a58f-4964-a9c4-bca0372e7068 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:39.989911 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00df7252-a58f-4964-a9c4-bca0372e7068 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:39.990321 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00df7252-a58f-4964-a9c4-bca0372e7068 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:39.991018 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00df7252-a58f-4964-a9c4-bca0372e7068 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:39.991475 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00df7252-a58f-4964-a9c4-bca0372e7068 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:39.991905 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00df7252-a58f-4964-a9c4-bca0372e7068 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:40.122123 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-00df7252-a58f-4964-a9c4-bca0372e7068 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:40.135676 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-00df7252-a58f-4964-a9c4-bca0372e7068 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1265 microversion: 2.1 time: 0.157178 Aug 05 02:33:40.136263 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 615/1231] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:39 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:41.157284 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4f5329d0-fdae-4599-b294-479d7133308e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:41.157914 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4f5329d0-fdae-4599-b294-479d7133308e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:41.160302 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:41.160972 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:41.166648 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f5329d0-fdae-4599-b294-479d7133308e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:41.167119 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f5329d0-fdae-4599-b294-479d7133308e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:41.167541 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f5329d0-fdae-4599-b294-479d7133308e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:41.168214 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f5329d0-fdae-4599-b294-479d7133308e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:41.168684 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f5329d0-fdae-4599-b294-479d7133308e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:41.169096 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4f5329d0-fdae-4599-b294-479d7133308e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:41.305116 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4f5329d0-fdae-4599-b294-479d7133308e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:41.312550 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4f5329d0-fdae-4599-b294-479d7133308e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1265 microversion: 2.1 time: 0.159030 Aug 05 02:33:41.313120 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 617/1232] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:41 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:42.334323 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a6e8f486-d6ee-4a4c-b76f-82890f47e420 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:42.334939 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a6e8f486-d6ee-4a4c-b76f-82890f47e420 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:42.337129 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:42.342648 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6e8f486-d6ee-4a4c-b76f-82890f47e420 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:42.343126 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6e8f486-d6ee-4a4c-b76f-82890f47e420 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:42.343560 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6e8f486-d6ee-4a4c-b76f-82890f47e420 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:42.344304 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6e8f486-d6ee-4a4c-b76f-82890f47e420 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:42.344782 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6e8f486-d6ee-4a4c-b76f-82890f47e420 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:42.345205 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6e8f486-d6ee-4a4c-b76f-82890f47e420 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:42.483762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a6e8f486-d6ee-4a4c-b76f-82890f47e420 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:42.491823 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a6e8f486-d6ee-4a4c-b76f-82890f47e420 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1265 microversion: 2.1 time: 0.161975 Aug 05 02:33:42.492411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 616/1233] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:42 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:43.512662 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ba272a5f-b40d-42a6-8e76-bd5b7ee1718a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:43.513207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ba272a5f-b40d-42a6-8e76-bd5b7ee1718a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:43.519617 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ba272a5f-b40d-42a6-8e76-bd5b7ee1718a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:43.520105 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ba272a5f-b40d-42a6-8e76-bd5b7ee1718a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:43.520556 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ba272a5f-b40d-42a6-8e76-bd5b7ee1718a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:43.521238 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ba272a5f-b40d-42a6-8e76-bd5b7ee1718a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:43.521680 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ba272a5f-b40d-42a6-8e76-bd5b7ee1718a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:43.522094 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ba272a5f-b40d-42a6-8e76-bd5b7ee1718a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:43.656939 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ba272a5f-b40d-42a6-8e76-bd5b7ee1718a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:43.664416 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ba272a5f-b40d-42a6-8e76-bd5b7ee1718a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1265 microversion: 2.1 time: 0.155671 Aug 05 02:33:43.664985 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 618/1234] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:43 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:44.685673 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7dbb0df9-32f4-4889-93e2-859e9dabd75a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:44.686280 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7dbb0df9-32f4-4889-93e2-859e9dabd75a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:44.692887 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7dbb0df9-32f4-4889-93e2-859e9dabd75a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:44.693497 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7dbb0df9-32f4-4889-93e2-859e9dabd75a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:44.693930 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7dbb0df9-32f4-4889-93e2-859e9dabd75a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:44.694614 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7dbb0df9-32f4-4889-93e2-859e9dabd75a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:44.695060 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7dbb0df9-32f4-4889-93e2-859e9dabd75a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:44.695478 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7dbb0df9-32f4-4889-93e2-859e9dabd75a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:44.827261 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7dbb0df9-32f4-4889-93e2-859e9dabd75a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:44.835383 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7dbb0df9-32f4-4889-93e2-859e9dabd75a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1265 microversion: 2.1 time: 0.153495 Aug 05 02:33:44.835937 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 617/1235] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:44 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:45.655440 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-bb7ad1a1-a41b-4280-bc19-084ff4b42241 req-1cb9b6b7-1e83-4971-aa03-c65d237c7bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d", "name": "network-vif-plugged", "status": "completed", "tag": "05c19a4c-fc1d-4eb9-b7d1-a74975263d45"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:33:45.665531 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-bb7ad1a1-a41b-4280-bc19-084ff4b42241 req-1cb9b6b7-1e83-4971-aa03-c65d237c7bfd service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:45.666082 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-bb7ad1a1-a41b-4280-bc19-084ff4b42241 req-1cb9b6b7-1e83-4971-aa03-c65d237c7bfd service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:45.666527 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-bb7ad1a1-a41b-4280-bc19-084ff4b42241 req-1cb9b6b7-1e83-4971-aa03-c65d237c7bfd service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:45.678508 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-bb7ad1a1-a41b-4280-bc19-084ff4b42241 req-1cb9b6b7-1e83-4971-aa03-c65d237c7bfd service nova] Creating event network-vif-plugged:05c19a4c-fc1d-4eb9-b7d1-a74975263d45 for instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d on hv-cinder-81558 Aug 05 02:33:45.683675 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-bb7ad1a1-a41b-4280-bc19-084ff4b42241 req-1cb9b6b7-1e83-4971-aa03-c65d237c7bfd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032193 Aug 05 02:33:45.684263 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 619/1236] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:33:45.855570 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-02de958e-a043-40cc-94c1-1f4db5334d52 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:45.856181 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-02de958e-a043-40cc-94c1-1f4db5334d52 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:45.863855 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02de958e-a043-40cc-94c1-1f4db5334d52 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:45.864420 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02de958e-a043-40cc-94c1-1f4db5334d52 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:45.864874 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02de958e-a043-40cc-94c1-1f4db5334d52 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:45.866275 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02de958e-a043-40cc-94c1-1f4db5334d52 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:45.866727 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02de958e-a043-40cc-94c1-1f4db5334d52 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:45.867151 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02de958e-a043-40cc-94c1-1f4db5334d52 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:46.008664 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-02de958e-a043-40cc-94c1-1f4db5334d52 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:46.016001 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-02de958e-a043-40cc-94c1-1f4db5334d52 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1265 microversion: 2.1 time: 0.164356 Aug 05 02:33:46.016589 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 618/1237] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:45 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:47.038421 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9136bcfc-bb5b-47bb-b8a7-f28b8fe3b0d3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:47.039125 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9136bcfc-bb5b-47bb-b8a7-f28b8fe3b0d3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:47.045213 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9136bcfc-bb5b-47bb-b8a7-f28b8fe3b0d3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:47.045693 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9136bcfc-bb5b-47bb-b8a7-f28b8fe3b0d3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:47.046130 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9136bcfc-bb5b-47bb-b8a7-f28b8fe3b0d3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:47.046811 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9136bcfc-bb5b-47bb-b8a7-f28b8fe3b0d3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:47.047262 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9136bcfc-bb5b-47bb-b8a7-f28b8fe3b0d3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:47.047702 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9136bcfc-bb5b-47bb-b8a7-f28b8fe3b0d3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:47.179434 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-9136bcfc-bb5b-47bb-b8a7-f28b8fe3b0d3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:47.186821 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9136bcfc-bb5b-47bb-b8a7-f28b8fe3b0d3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1265 microversion: 2.1 time: 0.154158 Aug 05 02:33:47.187375 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 620/1238] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:47 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:48.207531 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1eb313e3-98a3-4b23-8f2d-8f3db7cb41d8 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:48.208135 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1eb313e3-98a3-4b23-8f2d-8f3db7cb41d8 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:48.214950 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1eb313e3-98a3-4b23-8f2d-8f3db7cb41d8 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:48.215420 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1eb313e3-98a3-4b23-8f2d-8f3db7cb41d8 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:48.215849 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1eb313e3-98a3-4b23-8f2d-8f3db7cb41d8 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:48.216551 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1eb313e3-98a3-4b23-8f2d-8f3db7cb41d8 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:48.217005 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1eb313e3-98a3-4b23-8f2d-8f3db7cb41d8 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:48.217421 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1eb313e3-98a3-4b23-8f2d-8f3db7cb41d8 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:48.346869 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1eb313e3-98a3-4b23-8f2d-8f3db7cb41d8 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:48.355019 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1eb313e3-98a3-4b23-8f2d-8f3db7cb41d8 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1453 microversion: 2.1 time: 0.151352 Aug 05 02:33:48.355604 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 619/1239] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:48 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:48.375386 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c70348ed-331d-49cd-90c4-8197aa398a97 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:48.376181 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c70348ed-331d-49cd-90c4-8197aa398a97 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:48.382763 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c70348ed-331d-49cd-90c4-8197aa398a97 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:48.383246 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c70348ed-331d-49cd-90c4-8197aa398a97 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:48.383682 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c70348ed-331d-49cd-90c4-8197aa398a97 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:48.384403 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c70348ed-331d-49cd-90c4-8197aa398a97 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:48.384857 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c70348ed-331d-49cd-90c4-8197aa398a97 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:48.385279 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c70348ed-331d-49cd-90c4-8197aa398a97 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:48.516348 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c70348ed-331d-49cd-90c4-8197aa398a97 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:48.524135 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c70348ed-331d-49cd-90c4-8197aa398a97 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1453 microversion: 2.1 time: 0.152655 Aug 05 02:33:48.524741 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 621/1240] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:48 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:50.432894 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-835ffeaa-40a2-4bec-930a-4fe98b0961cf req-6728b279-be1d-4947-823a-80a2d651da4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d", "tag": "05c19a4c-fc1d-4eb9-b7d1-a74975263d45"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:33:50.442725 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-835ffeaa-40a2-4bec-930a-4fe98b0961cf req-6728b279-be1d-4947-823a-80a2d651da4a service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:50.443855 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-835ffeaa-40a2-4bec-930a-4fe98b0961cf req-6728b279-be1d-4947-823a-80a2d651da4a service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:50.444283 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-835ffeaa-40a2-4bec-930a-4fe98b0961cf req-6728b279-be1d-4947-823a-80a2d651da4a service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:50.454964 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-835ffeaa-40a2-4bec-930a-4fe98b0961cf req-6728b279-be1d-4947-823a-80a2d651da4a service nova] Creating event network-changed:05c19a4c-fc1d-4eb9-b7d1-a74975263d45 for instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d on hv-cinder-81558 Aug 05 02:33:50.460069 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-835ffeaa-40a2-4bec-930a-4fe98b0961cf req-6728b279-be1d-4947-823a-80a2d651da4a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030925 Aug 05 02:33:50.460878 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 620/1241] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:33:53.145762 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-0417f3bb-1381-4e4c-b004-d86d9bae91b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:53.146564 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0417f3bb-1381-4e4c-b004-d86d9bae91b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:53.148400 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-769f4bde-e01e-4fdf-9a3d-73800853d62a req-1dd5b88a-3e82-450c-ad12-e94e07923016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb56ea7-8771-41b9-b537-a6d4afeda7ab", "tag": "652b8180-4f83-4880-81b9-b44df98605a9"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:33:53.153870 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0417f3bb-1381-4e4c-b004-d86d9bae91b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:53.154631 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0417f3bb-1381-4e4c-b004-d86d9bae91b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:53.155140 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0417f3bb-1381-4e4c-b004-d86d9bae91b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:53.155910 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0417f3bb-1381-4e4c-b004-d86d9bae91b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:53.156620 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0417f3bb-1381-4e4c-b004-d86d9bae91b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:53.157134 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-0417f3bb-1381-4e4c-b004-d86d9bae91b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:53.160008 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-769f4bde-e01e-4fdf-9a3d-73800853d62a req-1dd5b88a-3e82-450c-ad12-e94e07923016 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:53.160510 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-769f4bde-e01e-4fdf-9a3d-73800853d62a req-1dd5b88a-3e82-450c-ad12-e94e07923016 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:53.160931 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-769f4bde-e01e-4fdf-9a3d-73800853d62a req-1dd5b88a-3e82-450c-ad12-e94e07923016 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:53.172490 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-769f4bde-e01e-4fdf-9a3d-73800853d62a req-1dd5b88a-3e82-450c-ad12-e94e07923016 service nova] Creating event network-changed:652b8180-4f83-4880-81b9-b44df98605a9 for instance 5eb56ea7-8771-41b9-b537-a6d4afeda7ab on hv-cinder-81558 Aug 05 02:33:53.178476 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-769f4bde-e01e-4fdf-9a3d-73800853d62a req-1dd5b88a-3e82-450c-ad12-e94e07923016 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034217 Aug 05 02:33:53.179788 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 621/1242] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:33:53.183636 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-0417f3bb-1381-4e4c-b004-d86d9bae91b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:33:53.264044 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-0417f3bb-1381-4e4c-b004-d86d9bae91b7 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 204 len: 0 microversion: 2.1 time: 0.121133 Aug 05 02:33:53.264753 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 622/1243] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:33:53 2022] DELETE /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:33:53.274766 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-49e04a85-c32b-48a9-8370-f8685bd731b3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:53.275461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-49e04a85-c32b-48a9-8370-f8685bd731b3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:53.284647 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49e04a85-c32b-48a9-8370-f8685bd731b3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:53.285134 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49e04a85-c32b-48a9-8370-f8685bd731b3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:53.285569 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49e04a85-c32b-48a9-8370-f8685bd731b3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:53.286288 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49e04a85-c32b-48a9-8370-f8685bd731b3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:53.286798 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49e04a85-c32b-48a9-8370-f8685bd731b3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:53.287728 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49e04a85-c32b-48a9-8370-f8685bd731b3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:53.428055 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-49e04a85-c32b-48a9-8370-f8685bd731b3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:53.435906 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-49e04a85-c32b-48a9-8370-f8685bd731b3 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.166314 Aug 05 02:33:53.436492 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 622/1244] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:53 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:54.459519 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c914ab4f-d856-476c-97f6-ae659fd2a9ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:54.460204 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c914ab4f-d856-476c-97f6-ae659fd2a9ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:54.466902 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c914ab4f-d856-476c-97f6-ae659fd2a9ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:54.467739 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c914ab4f-d856-476c-97f6-ae659fd2a9ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:54.467886 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c914ab4f-d856-476c-97f6-ae659fd2a9ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:54.468495 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c914ab4f-d856-476c-97f6-ae659fd2a9ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:54.468941 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c914ab4f-d856-476c-97f6-ae659fd2a9ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:54.469360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c914ab4f-d856-476c-97f6-ae659fd2a9ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:54.670834 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c914ab4f-d856-476c-97f6-ae659fd2a9ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:54.679325 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c914ab4f-d856-476c-97f6-ae659fd2a9ee tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1569 microversion: 2.1 time: 0.224619 Aug 05 02:33:54.679887 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 623/1245] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:54 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:55.642662 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-07c75864-f021-4c5a-9c24-c5ae642476b2 req-10534204-e993-4cf0-add0-3d12cf9e5c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb56ea7-8771-41b9-b537-a6d4afeda7ab", "name": "network-vif-deleted", "tag": "652b8180-4f83-4880-81b9-b44df98605a9"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:33:55.653946 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-07c75864-f021-4c5a-9c24-c5ae642476b2 req-10534204-e993-4cf0-add0-3d12cf9e5c40 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:55.654463 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-07c75864-f021-4c5a-9c24-c5ae642476b2 req-10534204-e993-4cf0-add0-3d12cf9e5c40 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:55.654922 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-07c75864-f021-4c5a-9c24-c5ae642476b2 req-10534204-e993-4cf0-add0-3d12cf9e5c40 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:55.667132 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-07c75864-f021-4c5a-9c24-c5ae642476b2 req-10534204-e993-4cf0-add0-3d12cf9e5c40 service nova] Creating event network-vif-deleted:652b8180-4f83-4880-81b9-b44df98605a9 for instance 5eb56ea7-8771-41b9-b537-a6d4afeda7ab on hv-cinder-81558 Aug 05 02:33:55.673343 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-07c75864-f021-4c5a-9c24-c5ae642476b2 req-10534204-e993-4cf0-add0-3d12cf9e5c40 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034212 Aug 05 02:33:55.673748 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 623/1246] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:33:55.700656 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-20a3c7cd-2314-4165-925c-f791ae3aac1f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:55.701386 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-20a3c7cd-2314-4165-925c-f791ae3aac1f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:55.707874 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20a3c7cd-2314-4165-925c-f791ae3aac1f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:55.708396 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20a3c7cd-2314-4165-925c-f791ae3aac1f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:55.708990 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20a3c7cd-2314-4165-925c-f791ae3aac1f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:55.709687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20a3c7cd-2314-4165-925c-f791ae3aac1f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:55.710144 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20a3c7cd-2314-4165-925c-f791ae3aac1f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:55.710568 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-20a3c7cd-2314-4165-925c-f791ae3aac1f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:55.775613 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-20a3c7cd-2314-4165-925c-f791ae3aac1f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7166065ae65434fbeaff2993a21cc01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:33:55.783242 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-20a3c7cd-2314-4165-925c-f791ae3aac1f tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 200 len: 1219 microversion: 2.1 time: 0.086406 Aug 05 02:33:55.783801 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 624/1247] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:55 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:33:56.496031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:33:56.496263 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Fri Aug 5 02:33:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:33:56.805964 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-09c8027e-6529-4376-a4a4-9be8d3364541 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:56.806636 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-09c8027e-6529-4376-a4a4-9be8d3364541 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] [instance: 5eb56ea7-8771-41b9-b537-a6d4afeda7ab] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:33:56.812651 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09c8027e-6529-4376-a4a4-9be8d3364541 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:56.813128 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09c8027e-6529-4376-a4a4-9be8d3364541 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:56.813562 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09c8027e-6529-4376-a4a4-9be8d3364541 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:56.814252 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09c8027e-6529-4376-a4a4-9be8d3364541 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:33:56.814700 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09c8027e-6529-4376-a4a4-9be8d3364541 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:33:56.815120 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-09c8027e-6529-4376-a4a4-9be8d3364541 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:33:56.830106 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-09c8027e-6529-4376-a4a4-9be8d3364541 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] HTTP exception thrown: Instance 5eb56ea7-8771-41b9-b537-a6d4afeda7ab could not be found. Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-09c8027e-6529-4376-a4a4-9be8d3364541 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Request method failure captured: Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab HTTP/1.1 Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7IAJKeJqUuNvc0CvUi0XdE7ZNfjSxc2HAT8FMq5BFICtpe6jP-Q8jhz3LDJFLddKyLdXJ2XC2eeRqvbkaHI4LR0N6brmVRqnl081Zt_DdAE8mO-olkI5F4Q86_EK0_gCatj0jY1CqfgnFCWVf88RNtZXpg00bXmcJRi2eHk8NTzW59k Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: b3677b84efd24f76bbbc0f8a762ec3f5 Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestShelveInstance-974023362 Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:33:56.831781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:33:56.834184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b3677b84efd24f76bbbc0f8a762ec3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b3677b84efd24f76bbbc0f8a762ec3f5", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b3677b84efd24f76bbbc0f8a762ec3f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b3677b84efd24f76bbbc0f8a762ec3f5"}]}] Aug 05 02:33:56.834184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestShelveInstance-974023362 Aug 05 02:33:56.834184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: b3677b84efd24f76bbbc0f8a762ec3f5 Aug 05 02:33:56.834184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestShelveInstance-974023362 Aug 05 02:33:56.834184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-TestShelveInstance-974023362-project Aug 05 02:33:56.834184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:33:56.834184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:33:56.834184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: d7166065ae65434fbeaff2993a21cc01 Aug 05 02:33:56.834184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestShelveInstance-974023362-project Aug 05 02:33:56.834184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:33:56.834184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 5eb56ea7-8771-41b9-b537-a6d4afeda7ab could not be found. Aug 05 02:33:56.834184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '5eb56ea7-8771-41b9-b537-a6d4afeda7ab'} Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb56ea7-8771-41b9-b537-a6d4afeda7ab could not be found. Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:33:56.835144 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb56ea7-8771-41b9-b537-a6d4afeda7ab could not be found. Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb56ea7-8771-41b9-b537-a6d4afeda7ab could not be found. Aug 05 02:33:56.837461 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:33:56.838777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-09c8027e-6529-4376-a4a4-9be8d3364541 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Returning 404 to user: Instance 5eb56ea7-8771-41b9-b537-a6d4afeda7ab could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:33:56.838777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-09c8027e-6529-4376-a4a4-9be8d3364541 tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab" status: 404 len: 111 microversion: 2.1 time: 0.032344 Aug 05 02:33:56.838777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 624/1248] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:33:56 2022] GET /compute/v2.1/servers/5eb56ea7-8771-41b9-b537-a6d4afeda7ab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:33:56.993001 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-31bd9a1d-dc02-4c8e-a823-fd2052028beb tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] Calling method '.version_select at 0x7fa65c5e83a0>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:33:57.013327 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-31bd9a1d-dc02-4c8e-a823-fd2052028beb tempest-TestShelveInstance-974023362 tempest-TestShelveInstance-974023362-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-346462205" status: 202 len: 0 microversion: 2.1 time: 0.024663 Aug 05 02:33:57.014001 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 625/1249] 10.222.0.15 () {58 vars in 1251 bytes} [Fri Aug 5 02:33:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-346462205 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:35:26.182576 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:35:26.183184 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Fri Aug 5 02:35:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:35:38.812043 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:35:38.812736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Fri Aug 5 02:35:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:35:57.781905 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:35:57.782530 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Fri Aug 5 02:35:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:35:58.920534 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:35:58.921072 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Fri Aug 5 02:35:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:36:04.450437 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d2081dc-756d-49ab-baf0-5b7c4886cd74] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 05 02:36:04.450954 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=30 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:36:04.451675 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=62 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:36:04.455776 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0d981545-2a7d-4620-b49c-23a32a037cb3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:04.456351 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0d981545-2a7d-4620-b49c-23a32a037cb3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:04.464548 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d981545-2a7d-4620-b49c-23a32a037cb3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:04.465026 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d981545-2a7d-4620-b49c-23a32a037cb3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:04.465452 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d981545-2a7d-4620-b49c-23a32a037cb3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:04.466126 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d981545-2a7d-4620-b49c-23a32a037cb3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:04.466570 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d981545-2a7d-4620-b49c-23a32a037cb3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:04.466985 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0d981545-2a7d-4620-b49c-23a32a037cb3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:04.490844 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0d981545-2a7d-4620-b49c-23a32a037cb3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:36:04.567060 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0d981545-2a7d-4620-b49c-23a32a037cb3 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 204 len: 0 microversion: 2.1 time: 0.118288 Aug 05 02:36:04.567741 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 625/1250] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:36:04 2022] DELETE /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:36:04.574845 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d3f6ac14-0f77-40fd-96b2-581f73d15ade] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 05 02:36:04.575394 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:36:04.576127 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:36:04.581418 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-57bb82e1-bcee-4811-a360-4af9e6e81514 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:04.582029 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-57bb82e1-bcee-4811-a360-4af9e6e81514 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:04.590733 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57bb82e1-bcee-4811-a360-4af9e6e81514 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:04.591214 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57bb82e1-bcee-4811-a360-4af9e6e81514 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:04.591649 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57bb82e1-bcee-4811-a360-4af9e6e81514 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:04.592383 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57bb82e1-bcee-4811-a360-4af9e6e81514 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:04.592848 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57bb82e1-bcee-4811-a360-4af9e6e81514 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:04.593268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-57bb82e1-bcee-4811-a360-4af9e6e81514 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:04.924278 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-57bb82e1-bcee-4811-a360-4af9e6e81514 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:04.932559 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-57bb82e1-bcee-4811-a360-4af9e6e81514 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1578 microversion: 2.1 time: 0.359444 Aug 05 02:36:04.933127 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 626/1251] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:04 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1578 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:36:05.954576 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6f127379-dad1-49b2-9bef-78c136c256bb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:05.955181 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6f127379-dad1-49b2-9bef-78c136c256bb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:05.963899 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f127379-dad1-49b2-9bef-78c136c256bb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:05.964403 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f127379-dad1-49b2-9bef-78c136c256bb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:05.964835 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f127379-dad1-49b2-9bef-78c136c256bb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:05.965531 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f127379-dad1-49b2-9bef-78c136c256bb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:05.965978 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f127379-dad1-49b2-9bef-78c136c256bb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:05.966405 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f127379-dad1-49b2-9bef-78c136c256bb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:05.971889 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d2081dc-756d-49ab-baf0-5b7c4886cd74] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 35142. Aug 05 02:36:06.154622 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6f127379-dad1-49b2-9bef-78c136c256bb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:06.162145 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6f127379-dad1-49b2-9bef-78c136c256bb tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1578 microversion: 2.1 time: 0.211840 Aug 05 02:36:06.162727 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 626/1252] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:05 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1578 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:36:07.184515 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-85d01403-91be-43a6-9d7b-ff3a23df88ce tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:07.185190 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-85d01403-91be-43a6-9d7b-ff3a23df88ce tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:07.193023 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-85d01403-91be-43a6-9d7b-ff3a23df88ce tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:07.193509 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-85d01403-91be-43a6-9d7b-ff3a23df88ce tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:07.193944 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-85d01403-91be-43a6-9d7b-ff3a23df88ce tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:07.194877 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-85d01403-91be-43a6-9d7b-ff3a23df88ce tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:07.195327 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-85d01403-91be-43a6-9d7b-ff3a23df88ce tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:07.195750 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-85d01403-91be-43a6-9d7b-ff3a23df88ce tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:07.212359 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] [d3f6ac14-0f77-40fd-96b2-581f73d15ade] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 35150. Aug 05 02:36:07.315142 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-85d01403-91be-43a6-9d7b-ff3a23df88ce tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:07.316075 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-66a9a76e-b218-4503-8f7c-0cb7954d2bb7 req-8194b973-d310-4116-ba06-e0a9e467140d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d", "name": "network-vif-deleted", "tag": "05c19a4c-fc1d-4eb9-b7d1-a74975263d45"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:36:07.325433 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-85d01403-91be-43a6-9d7b-ff3a23df88ce tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 200 len: 1511 microversion: 2.1 time: 0.144748 Aug 05 02:36:07.326348 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 627/1253] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:07 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 1511 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:36:07.336177 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-66a9a76e-b218-4503-8f7c-0cb7954d2bb7 req-8194b973-d310-4116-ba06-e0a9e467140d service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:07.336665 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-66a9a76e-b218-4503-8f7c-0cb7954d2bb7 req-8194b973-d310-4116-ba06-e0a9e467140d service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:07.337205 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-66a9a76e-b218-4503-8f7c-0cb7954d2bb7 req-8194b973-d310-4116-ba06-e0a9e467140d service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:07.351343 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-66a9a76e-b218-4503-8f7c-0cb7954d2bb7 req-8194b973-d310-4116-ba06-e0a9e467140d service nova] Creating event network-vif-deleted:05c19a4c-fc1d-4eb9-b7d1-a74975263d45 for instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d on hv-cinder-81558 Aug 05 02:36:07.357006 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-66a9a76e-b218-4503-8f7c-0cb7954d2bb7 req-8194b973-d310-4116-ba06-e0a9e467140d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047283 Aug 05 02:36:07.361632 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 627/1254] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:36:08.354413 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8e2c1b71-19fa-4f87-b2e8-809348781c88 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:08.355022 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8e2c1b71-19fa-4f87-b2e8-809348781c88 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:08.361385 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8e2c1b71-19fa-4f87-b2e8-809348781c88 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:08.361867 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8e2c1b71-19fa-4f87-b2e8-809348781c88 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:08.362301 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8e2c1b71-19fa-4f87-b2e8-809348781c88 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:08.362984 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8e2c1b71-19fa-4f87-b2e8-809348781c88 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:08.363432 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8e2c1b71-19fa-4f87-b2e8-809348781c88 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:08.363854 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8e2c1b71-19fa-4f87-b2e8-809348781c88 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:08.377791 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-8e2c1b71-19fa-4f87-b2e8-809348781c88 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] HTTP exception thrown: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8e2c1b71-19fa-4f87-b2e8-809348781c88 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Request method failure captured: Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d HTTP/1.1 Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7IFXsRyRlyF18YEmzIIFPaB-Cy7lmBdWPjbtt4vbuRTZg5uYrlxk3bFcEAU1sNHf8qNgAFAHwTgW75cUpBr1mLHWLCvgso3vRc8WmVuk0PDSsP7OOB_J1Ae9HKPa7qIULXFC6czMO3Ar4swOQNlOFqeuI7mE_k1s8fG9FkPaLLZa1HY Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: 59a7ad5acdc34d0782e2c6807a4fd60f Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-TestVolumeBootPattern-1870709547 Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:36:08.379407 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:36:08.381330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/59a7ad5acdc34d0782e2c6807a4fd60f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_59a7ad5acdc34d0782e2c6807a4fd60f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59a7ad5acdc34d0782e2c6807a4fd60f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59a7ad5acdc34d0782e2c6807a4fd60f"}]}] Aug 05 02:36:08.381330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-TestVolumeBootPattern-1870709547 Aug 05 02:36:08.381330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 59a7ad5acdc34d0782e2c6807a4fd60f Aug 05 02:36:08.381330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870709547 Aug 05 02:36:08.381330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-TestVolumeBootPattern-1870709547-project Aug 05 02:36:08.381330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:36:08.381330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:36:08.381330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 5f163bd8d55e47019d7e7ef5ade78b38 Aug 05 02:36:08.381330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-TestVolumeBootPattern-1870709547-project Aug 05 02:36:08.381330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:36:08.381330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. Aug 05 02:36:08.381330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': '3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d'} Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:36:08.382625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. Aug 05 02:36:08.384307 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:36:08.385832 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8e2c1b71-19fa-4f87-b2e8-809348781c88 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Returning 404 to user: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:36:08.385832 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8e2c1b71-19fa-4f87-b2e8-809348781c88 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 404 len: 111 microversion: 2.1 time: 0.031201 Aug 05 02:36:08.385832 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 628/1255] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:08 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:36:08.482982 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-899136661", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-592323774", "security_groups": [{"name": "tempest-secgroup-smoke-561808126"}], "block_device_mapping_v2": [{"uuid": "19896e1e-75d8-4f03-8f85-1f1141b115a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9b4600cc-d12c-464b-9ce2-d2bcd950bd3f"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:36:08.595534 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] validate_networks() for [('9b4600cc-d12c-464b-9ce2-d2bcd950bd3f', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:36:09.017274 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:36:09.017697 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:36:09.018213 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:36:09.018561 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:36:09.018964 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:36:09.027879 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:09.028368 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:09.028799 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:09.029511 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:09.029962 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:09.030374 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:09.047139 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Getting quotas for project 59a7ad5acdc34d0782e2c6807a4fd60f. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:36:09.051000 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Getting quotas for user 5f163bd8d55e47019d7e7ef5ade78b38 and project 59a7ad5acdc34d0782e2c6807a4fd60f. Resources: {'ram', 'instances', 'cores'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:36:09.109638 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:36:09.112874 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='19896e1e-75d8-4f03-8f85-1f1141b115a1',volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:36:09.247539 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2eb88f9a-a5f9-4fea-ac49-a7aa4533489a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.769103 Aug 05 02:36:09.248171 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 628/1256] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:36:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:36:09.259879 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-50a54a75-dc04-4ae9-bfc5-ea1d6624489d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:09.260492 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-50a54a75-dc04-4ae9-bfc5-ea1d6624489d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:09.324465 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-50a54a75-dc04-4ae9-bfc5-ea1d6624489d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:09.331162 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-50a54a75-dc04-4ae9-bfc5-ea1d6624489d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1093 microversion: 2.1 time: 0.075172 Aug 05 02:36:09.331687 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 629/1257] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:09 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:36:10.351971 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c0daef2d-27b1-44cc-8e1d-911a3a41f558 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:10.353247 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c0daef2d-27b1-44cc-8e1d-911a3a41f558 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:10.359784 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0daef2d-27b1-44cc-8e1d-911a3a41f558 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:10.360272 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0daef2d-27b1-44cc-8e1d-911a3a41f558 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:10.360721 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0daef2d-27b1-44cc-8e1d-911a3a41f558 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:10.361421 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0daef2d-27b1-44cc-8e1d-911a3a41f558 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:10.361867 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0daef2d-27b1-44cc-8e1d-911a3a41f558 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:10.362286 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c0daef2d-27b1-44cc-8e1d-911a3a41f558 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:10.430264 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c0daef2d-27b1-44cc-8e1d-911a3a41f558 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:10.437781 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c0daef2d-27b1-44cc-8e1d-911a3a41f558 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1209 microversion: 2.1 time: 0.090618 Aug 05 02:36:10.438344 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 629/1258] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:10 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:36:11.458876 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c5bd8916-0ddb-4391-b26c-d9ba40bf6364 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:11.459487 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c5bd8916-0ddb-4391-b26c-d9ba40bf6364 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:11.467519 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c5bd8916-0ddb-4391-b26c-d9ba40bf6364 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:11.468059 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c5bd8916-0ddb-4391-b26c-d9ba40bf6364 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:11.468463 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c5bd8916-0ddb-4391-b26c-d9ba40bf6364 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:11.469165 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c5bd8916-0ddb-4391-b26c-d9ba40bf6364 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:11.469618 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c5bd8916-0ddb-4391-b26c-d9ba40bf6364 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:11.470042 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c5bd8916-0ddb-4391-b26c-d9ba40bf6364 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:11.661721 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c5bd8916-0ddb-4391-b26c-d9ba40bf6364 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:11.670255 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c5bd8916-0ddb-4391-b26c-d9ba40bf6364 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1264 microversion: 2.1 time: 0.215137 Aug 05 02:36:11.671011 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-0918ad5e-0d90-47be-9cf2-ed4784308e22 req-59c80e2e-c214-47d6-b913-347f5f83dba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "448fb5f6-7616-4be3-bd7c-2851aca8c865", "tag": "a3416a42-520d-4b05-a1b9-2f9d757bc127"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:36:11.671544 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 630/1259] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:11 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:36:11.688848 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0918ad5e-0d90-47be-9cf2-ed4784308e22 req-59c80e2e-c214-47d6-b913-347f5f83dba8 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:11.689332 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0918ad5e-0d90-47be-9cf2-ed4784308e22 req-59c80e2e-c214-47d6-b913-347f5f83dba8 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:11.690114 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-0918ad5e-0d90-47be-9cf2-ed4784308e22 req-59c80e2e-c214-47d6-b913-347f5f83dba8 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:11.702152 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-0918ad5e-0d90-47be-9cf2-ed4784308e22 req-59c80e2e-c214-47d6-b913-347f5f83dba8 service nova] Creating event network-changed:a3416a42-520d-4b05-a1b9-2f9d757bc127 for instance 448fb5f6-7616-4be3-bd7c-2851aca8c865 on hv-cinder-81558 Aug 05 02:36:11.707125 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-0918ad5e-0d90-47be-9cf2-ed4784308e22 req-59c80e2e-c214-47d6-b913-347f5f83dba8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039929 Aug 05 02:36:11.707797 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 630/1260] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:36:12.691952 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-520c3629-ee44-47e4-983e-075c35506d8d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:12.692592 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-520c3629-ee44-47e4-983e-075c35506d8d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:12.699685 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-520c3629-ee44-47e4-983e-075c35506d8d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:12.700161 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-520c3629-ee44-47e4-983e-075c35506d8d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:12.700624 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-520c3629-ee44-47e4-983e-075c35506d8d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:12.701308 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-520c3629-ee44-47e4-983e-075c35506d8d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:12.701757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-520c3629-ee44-47e4-983e-075c35506d8d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:12.702175 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-520c3629-ee44-47e4-983e-075c35506d8d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:12.836430 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-520c3629-ee44-47e4-983e-075c35506d8d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:12.844205 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-520c3629-ee44-47e4-983e-075c35506d8d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1264 microversion: 2.1 time: 0.155984 Aug 05 02:36:12.844811 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 631/1261] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:12 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:36:13.866518 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6319a9e7-6eab-4e49-a6b4-e42eb9000721 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:13.867201 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6319a9e7-6eab-4e49-a6b4-e42eb9000721 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:13.873338 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6319a9e7-6eab-4e49-a6b4-e42eb9000721 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:13.873818 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6319a9e7-6eab-4e49-a6b4-e42eb9000721 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:13.874281 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6319a9e7-6eab-4e49-a6b4-e42eb9000721 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:13.874959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6319a9e7-6eab-4e49-a6b4-e42eb9000721 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:13.875403 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6319a9e7-6eab-4e49-a6b4-e42eb9000721 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:13.875820 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6319a9e7-6eab-4e49-a6b4-e42eb9000721 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:14.007476 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6319a9e7-6eab-4e49-a6b4-e42eb9000721 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:14.014902 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6319a9e7-6eab-4e49-a6b4-e42eb9000721 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1264 microversion: 2.1 time: 0.153019 Aug 05 02:36:14.015460 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 631/1262] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:13 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:36:15.035234 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3c52157f-7c8e-480a-8fa6-79f8e7417972 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:15.035834 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3c52157f-7c8e-480a-8fa6-79f8e7417972 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:15.042743 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c52157f-7c8e-480a-8fa6-79f8e7417972 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:15.043214 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c52157f-7c8e-480a-8fa6-79f8e7417972 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:15.043642 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c52157f-7c8e-480a-8fa6-79f8e7417972 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:15.044336 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c52157f-7c8e-480a-8fa6-79f8e7417972 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:15.044789 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c52157f-7c8e-480a-8fa6-79f8e7417972 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:15.045204 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3c52157f-7c8e-480a-8fa6-79f8e7417972 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:15.173916 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3c52157f-7c8e-480a-8fa6-79f8e7417972 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:15.182044 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3c52157f-7c8e-480a-8fa6-79f8e7417972 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1264 microversion: 2.1 time: 0.150658 Aug 05 02:36:15.182610 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 632/1263] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:15 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:36:16.202801 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f0f7aded-2c85-4fcd-9024-6d7f84368a60 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:16.203408 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f0f7aded-2c85-4fcd-9024-6d7f84368a60 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:16.210643 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0f7aded-2c85-4fcd-9024-6d7f84368a60 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:16.211371 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0f7aded-2c85-4fcd-9024-6d7f84368a60 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:16.211802 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0f7aded-2c85-4fcd-9024-6d7f84368a60 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:16.212516 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0f7aded-2c85-4fcd-9024-6d7f84368a60 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:16.212962 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0f7aded-2c85-4fcd-9024-6d7f84368a60 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:16.213379 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0f7aded-2c85-4fcd-9024-6d7f84368a60 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:16.351572 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f0f7aded-2c85-4fcd-9024-6d7f84368a60 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:16.358984 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f0f7aded-2c85-4fcd-9024-6d7f84368a60 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1264 microversion: 2.1 time: 0.160194 Aug 05 02:36:16.359541 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 632/1264] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:16 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 05 02:36:17.378949 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f0a6734d-03fc-4ad8-9ec1-8dff8b388681 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:17.379562 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f0a6734d-03fc-4ad8-9ec1-8dff8b388681 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:17.386148 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0a6734d-03fc-4ad8-9ec1-8dff8b388681 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:17.386628 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0a6734d-03fc-4ad8-9ec1-8dff8b388681 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:17.387057 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0a6734d-03fc-4ad8-9ec1-8dff8b388681 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:17.387737 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0a6734d-03fc-4ad8-9ec1-8dff8b388681 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:17.388186 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0a6734d-03fc-4ad8-9ec1-8dff8b388681 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:17.388630 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f0a6734d-03fc-4ad8-9ec1-8dff8b388681 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:17.516178 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f0a6734d-03fc-4ad8-9ec1-8dff8b388681 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:17.523633 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f0a6734d-03fc-4ad8-9ec1-8dff8b388681 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1264 microversion: 2.1 time: 0.148528 Aug 05 02:36:17.524194 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 633/1265] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:17 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:36:18.544659 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f25b3955-dbb4-4138-82c1-6d03d6f129c5 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:18.545267 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f25b3955-dbb4-4138-82c1-6d03d6f129c5 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:18.551556 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f25b3955-dbb4-4138-82c1-6d03d6f129c5 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:18.552031 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f25b3955-dbb4-4138-82c1-6d03d6f129c5 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:18.552496 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f25b3955-dbb4-4138-82c1-6d03d6f129c5 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:18.553837 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f25b3955-dbb4-4138-82c1-6d03d6f129c5 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:18.554306 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f25b3955-dbb4-4138-82c1-6d03d6f129c5 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:18.554732 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f25b3955-dbb4-4138-82c1-6d03d6f129c5 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:18.685770 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f25b3955-dbb4-4138-82c1-6d03d6f129c5 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:18.693083 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f25b3955-dbb4-4138-82c1-6d03d6f129c5 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1264 microversion: 2.1 time: 0.152223 Aug 05 02:36:18.693641 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 633/1266] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:18 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:36:19.714725 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-6579c642-8d89-4b06-a6c2-376194b28811 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:19.715325 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-6579c642-8d89-4b06-a6c2-376194b28811 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:19.717617 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:36:19.723290 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6579c642-8d89-4b06-a6c2-376194b28811 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:19.723756 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6579c642-8d89-4b06-a6c2-376194b28811 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:19.724183 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6579c642-8d89-4b06-a6c2-376194b28811 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:19.724888 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6579c642-8d89-4b06-a6c2-376194b28811 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:19.725331 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6579c642-8d89-4b06-a6c2-376194b28811 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:19.725937 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-6579c642-8d89-4b06-a6c2-376194b28811 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:19.861456 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-6579c642-8d89-4b06-a6c2-376194b28811 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:19.868944 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-6579c642-8d89-4b06-a6c2-376194b28811 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1264 microversion: 2.1 time: 0.158626 Aug 05 02:36:19.869514 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 634/1267] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:19 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:36:20.890091 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b52e4164-64b6-40f5-8cf3-040de0f5cf3c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:20.890884 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b52e4164-64b6-40f5-8cf3-040de0f5cf3c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:20.893993 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:36:20.895140 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:36:20.901606 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b52e4164-64b6-40f5-8cf3-040de0f5cf3c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:20.902092 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b52e4164-64b6-40f5-8cf3-040de0f5cf3c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:20.902526 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b52e4164-64b6-40f5-8cf3-040de0f5cf3c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:20.903237 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b52e4164-64b6-40f5-8cf3-040de0f5cf3c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:20.903692 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b52e4164-64b6-40f5-8cf3-040de0f5cf3c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:20.904118 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b52e4164-64b6-40f5-8cf3-040de0f5cf3c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:21.035427 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b52e4164-64b6-40f5-8cf3-040de0f5cf3c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:21.043326 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b52e4164-64b6-40f5-8cf3-040de0f5cf3c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1264 microversion: 2.1 time: 0.157244 Aug 05 02:36:21.043888 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 634/1268] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:20 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:36:22.064194 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-78d94283-6250-43b8-81f3-afefc6b63f32 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:22.064808 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-78d94283-6250-43b8-81f3-afefc6b63f32 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:22.071443 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78d94283-6250-43b8-81f3-afefc6b63f32 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:22.071915 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78d94283-6250-43b8-81f3-afefc6b63f32 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:22.072362 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78d94283-6250-43b8-81f3-afefc6b63f32 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:22.073049 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78d94283-6250-43b8-81f3-afefc6b63f32 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:22.073496 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78d94283-6250-43b8-81f3-afefc6b63f32 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:22.073918 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78d94283-6250-43b8-81f3-afefc6b63f32 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:22.208342 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-78d94283-6250-43b8-81f3-afefc6b63f32 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:22.217008 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-78d94283-6250-43b8-81f3-afefc6b63f32 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1264 microversion: 2.1 time: 0.156588 Aug 05 02:36:22.217773 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 635/1269] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:22 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:36:22.423844 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-90a3afb9-e4ee-4749-8e19-687474c99e12 req-3ab6bebf-22ba-4898-830f-69c3b13ed8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448fb5f6-7616-4be3-bd7c-2851aca8c865", "name": "network-vif-plugged", "status": "completed", "tag": "a3416a42-520d-4b05-a1b9-2f9d757bc127"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:36:22.435815 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-90a3afb9-e4ee-4749-8e19-687474c99e12 req-3ab6bebf-22ba-4898-830f-69c3b13ed8f1 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:22.436375 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-90a3afb9-e4ee-4749-8e19-687474c99e12 req-3ab6bebf-22ba-4898-830f-69c3b13ed8f1 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:22.436877 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-90a3afb9-e4ee-4749-8e19-687474c99e12 req-3ab6bebf-22ba-4898-830f-69c3b13ed8f1 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:22.451484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-90a3afb9-e4ee-4749-8e19-687474c99e12 req-3ab6bebf-22ba-4898-830f-69c3b13ed8f1 service nova] Creating event network-vif-plugged:a3416a42-520d-4b05-a1b9-2f9d757bc127 for instance 448fb5f6-7616-4be3-bd7c-2851aca8c865 on hv-cinder-81558 Aug 05 02:36:22.456779 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-90a3afb9-e4ee-4749-8e19-687474c99e12 req-3ab6bebf-22ba-4898-830f-69c3b13ed8f1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037052 Aug 05 02:36:22.457376 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 635/1270] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:36:23.238283 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-3d31345a-55c6-405b-bf03-0cb1e8fc08fd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:23.238899 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-3d31345a-55c6-405b-bf03-0cb1e8fc08fd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:23.246286 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d31345a-55c6-405b-bf03-0cb1e8fc08fd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:23.246763 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d31345a-55c6-405b-bf03-0cb1e8fc08fd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:23.247198 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d31345a-55c6-405b-bf03-0cb1e8fc08fd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:23.247881 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d31345a-55c6-405b-bf03-0cb1e8fc08fd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:23.248352 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d31345a-55c6-405b-bf03-0cb1e8fc08fd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:23.248784 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-3d31345a-55c6-405b-bf03-0cb1e8fc08fd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:23.381170 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-3d31345a-55c6-405b-bf03-0cb1e8fc08fd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:23.388442 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-3d31345a-55c6-405b-bf03-0cb1e8fc08fd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1264 microversion: 2.1 time: 0.154001 Aug 05 02:36:23.388996 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 636/1271] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:23 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:36:24.409632 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9b629661-b5b4-45b7-8864-773e1d9eb04d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:24.410389 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9b629661-b5b4-45b7-8864-773e1d9eb04d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:24.417830 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b629661-b5b4-45b7-8864-773e1d9eb04d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:24.418311 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b629661-b5b4-45b7-8864-773e1d9eb04d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:24.418744 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b629661-b5b4-45b7-8864-773e1d9eb04d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:24.419430 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b629661-b5b4-45b7-8864-773e1d9eb04d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:24.419880 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b629661-b5b4-45b7-8864-773e1d9eb04d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:24.420303 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9b629661-b5b4-45b7-8864-773e1d9eb04d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:24.552214 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9b629661-b5b4-45b7-8864-773e1d9eb04d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:24.560570 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9b629661-b5b4-45b7-8864-773e1d9eb04d tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1451 microversion: 2.1 time: 0.155307 Aug 05 02:36:24.561140 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 636/1272] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:24 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:36:24.580865 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4b807758-176f-4178-be69-83587c7fbf29 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:36:24.581473 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4b807758-176f-4178-be69-83587c7fbf29 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:36:24.588994 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b807758-176f-4178-be69-83587c7fbf29 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:24.589484 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b807758-176f-4178-be69-83587c7fbf29 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:24.589917 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b807758-176f-4178-be69-83587c7fbf29 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:24.590843 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b807758-176f-4178-be69-83587c7fbf29 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:24.591281 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b807758-176f-4178-be69-83587c7fbf29 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:24.591697 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4b807758-176f-4178-be69-83587c7fbf29 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:24.725756 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4b807758-176f-4178-be69-83587c7fbf29 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:36:24.733625 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4b807758-176f-4178-be69-83587c7fbf29 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1451 microversion: 2.1 time: 0.156477 Aug 05 02:36:24.734206 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 637/1273] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:36:24 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:36:26.538030 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-20346a3d-6be0-4857-b356-f293230ab996 req-5e037432-2d7d-4f42-be63-7c7c1853d5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "448fb5f6-7616-4be3-bd7c-2851aca8c865", "tag": "a3416a42-520d-4b05-a1b9-2f9d757bc127"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:36:26.547392 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-20346a3d-6be0-4857-b356-f293230ab996 req-5e037432-2d7d-4f42-be63-7c7c1853d5c1 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:36:26.547941 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-20346a3d-6be0-4857-b356-f293230ab996 req-5e037432-2d7d-4f42-be63-7c7c1853d5c1 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:36:26.548468 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-20346a3d-6be0-4857-b356-f293230ab996 req-5e037432-2d7d-4f42-be63-7c7c1853d5c1 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:36:26.559230 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-20346a3d-6be0-4857-b356-f293230ab996 req-5e037432-2d7d-4f42-be63-7c7c1853d5c1 service nova] Creating event network-changed:a3416a42-520d-4b05-a1b9-2f9d757bc127 for instance 448fb5f6-7616-4be3-bd7c-2851aca8c865 on hv-cinder-81558 Aug 05 02:36:26.564259 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-20346a3d-6be0-4857-b356-f293230ab996 req-5e037432-2d7d-4f42-be63-7c7c1853d5c1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030169 Aug 05 02:36:26.565286 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 637/1274] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:37:08.944075 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:37:08.944690 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Fri Aug 5 02:37:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:38:25.356588 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=26 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:38:25.357336 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=62 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:38:25.361546 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2019970456", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-592323774", "security_groups": [{"name": "tempest-secgroup-smoke-561808126"}], "block_device_mapping_v2": [{"uuid": "c6b84060-6551-4188-a37d-e63fa6af9628", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9b4600cc-d12c-464b-9ce2-d2bcd950bd3f"}]}} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:38:25.472519 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.network.neutron [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] validate_networks() for [('9b4600cc-d12c-464b-9ce2-d2bcd950bd3f', None, None, None, None, None)] {{(pid=117921) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 05 02:38:25.834031 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Flavor limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 05 02:38:25.834708 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Image limits 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 05 02:38:25.835199 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Flavor pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 05 02:38:25.835605 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Image pref 0:0:0 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 05 02:38:25.837374 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.virt.hardware [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117921) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 05 02:38:25.846359 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:25.846866 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:25.847299 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:25.848068 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:25.848597 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:25.849021 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:25.865806 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Getting quotas for project 59a7ad5acdc34d0782e2c6807a4fd60f. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 05 02:38:25.869825 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.quota [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Getting quotas for user 5f163bd8d55e47019d7e7ef5ade78b38 and project 59a7ad5acdc34d0782e2c6807a4fd60f. Resources: {'ram', 'instances', 'cores'} {{(pid=117921) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 05 02:38:25.926484 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Going to run 1 instances... {{(pid=117921) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 05 02:38:25.928591 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c6b84060-6551-4188-a37d-e63fa6af9628',volume_size=None,volume_type=None)] {{(pid=117921) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 05 02:38:26.058054 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-63a724de-910b-484f-af51-636ee5228c3a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.703218 Aug 05 02:38:26.058688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 638/1275] 10.222.0.15 () {60 vars in 1147 bytes} [Fri Aug 5 02:38:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 05 02:38:26.067690 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:38:26.068506 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:38:26.075041 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-07ecd50a-a963-419d-9b16-a92e7d083f1c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:38:26.075745 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-07ecd50a-a963-419d-9b16-a92e7d083f1c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:38:26.138704 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-07ecd50a-a963-419d-9b16-a92e7d083f1c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:38:26.145378 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-07ecd50a-a963-419d-9b16-a92e7d083f1c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1094 microversion: 2.1 time: 0.079756 Aug 05 02:38:26.146130 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 638/1276] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:38:26 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:38:27.165849 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-f66a51db-6b19-4c8e-8c56-209d4c00c5d2 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:38:27.166412 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-f66a51db-6b19-4c8e-8c56-209d4c00c5d2 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:38:27.173464 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f66a51db-6b19-4c8e-8c56-209d4c00c5d2 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:27.173956 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f66a51db-6b19-4c8e-8c56-209d4c00c5d2 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:27.174392 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f66a51db-6b19-4c8e-8c56-209d4c00c5d2 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:27.175080 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f66a51db-6b19-4c8e-8c56-209d4c00c5d2 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:27.175526 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f66a51db-6b19-4c8e-8c56-209d4c00c5d2 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:27.175943 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-f66a51db-6b19-4c8e-8c56-209d4c00c5d2 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:27.252482 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-f66a51db-6b19-4c8e-8c56-209d4c00c5d2 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:38:27.262007 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-f66a51db-6b19-4c8e-8c56-209d4c00c5d2 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1200 microversion: 2.1 time: 0.100407 Aug 05 02:38:27.262720 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 639/1277] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:38:27 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1200 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:38:28.282917 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ef6adefa-d39b-461a-98df-afe7fd24b111 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:38:28.283601 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ef6adefa-d39b-461a-98df-afe7fd24b111 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:38:28.291747 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef6adefa-d39b-461a-98df-afe7fd24b111 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:28.292310 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef6adefa-d39b-461a-98df-afe7fd24b111 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:28.292777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef6adefa-d39b-461a-98df-afe7fd24b111 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:28.293474 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef6adefa-d39b-461a-98df-afe7fd24b111 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:28.293922 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef6adefa-d39b-461a-98df-afe7fd24b111 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:28.294343 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef6adefa-d39b-461a-98df-afe7fd24b111 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:28.426712 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ef6adefa-d39b-461a-98df-afe7fd24b111 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:38:28.435695 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ef6adefa-d39b-461a-98df-afe7fd24b111 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1265 microversion: 2.1 time: 0.156699 Aug 05 02:38:28.436262 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 639/1278] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:38:28 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:38:28.840214 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-505bb0c5-932e-41a2-97a8-c8b8c3998f01 req-2494dcae-7cfa-4b28-9572-fce92f80b791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba8009e-b081-467c-8a38-635518673040", "tag": "e05f53bc-41a1-41e4-be5a-a9e6158720cd"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:38:28.850109 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-505bb0c5-932e-41a2-97a8-c8b8c3998f01 req-2494dcae-7cfa-4b28-9572-fce92f80b791 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:28.850551 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-505bb0c5-932e-41a2-97a8-c8b8c3998f01 req-2494dcae-7cfa-4b28-9572-fce92f80b791 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:28.850971 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-505bb0c5-932e-41a2-97a8-c8b8c3998f01 req-2494dcae-7cfa-4b28-9572-fce92f80b791 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:28.862133 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-505bb0c5-932e-41a2-97a8-c8b8c3998f01 req-2494dcae-7cfa-4b28-9572-fce92f80b791 service nova] Creating event network-changed:e05f53bc-41a1-41e4-be5a-a9e6158720cd for instance 8ba8009e-b081-467c-8a38-635518673040 on hv-cinder-81558 Aug 05 02:38:28.868729 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-505bb0c5-932e-41a2-97a8-c8b8c3998f01 req-2494dcae-7cfa-4b28-9572-fce92f80b791 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101404 Aug 05 02:38:28.869314 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 640/1279] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:38:29.456188 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0a7f95ca-254c-447c-b1d5-6b3b05642ffd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:38:29.456833 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0a7f95ca-254c-447c-b1d5-6b3b05642ffd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:38:29.463440 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a7f95ca-254c-447c-b1d5-6b3b05642ffd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:29.463918 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a7f95ca-254c-447c-b1d5-6b3b05642ffd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:29.464378 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a7f95ca-254c-447c-b1d5-6b3b05642ffd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:29.465069 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a7f95ca-254c-447c-b1d5-6b3b05642ffd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:29.465518 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a7f95ca-254c-447c-b1d5-6b3b05642ffd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:29.465938 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0a7f95ca-254c-447c-b1d5-6b3b05642ffd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:29.598365 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0a7f95ca-254c-447c-b1d5-6b3b05642ffd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:38:29.606800 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0a7f95ca-254c-447c-b1d5-6b3b05642ffd tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1265 microversion: 2.1 time: 0.154447 Aug 05 02:38:29.607393 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 640/1280] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:38:29 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:38:30.627573 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-4106e5be-bda3-4c41-b1b9-e171d9c7706b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:38:30.628267 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-4106e5be-bda3-4c41-b1b9-e171d9c7706b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:38:30.634909 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4106e5be-bda3-4c41-b1b9-e171d9c7706b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:30.635393 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4106e5be-bda3-4c41-b1b9-e171d9c7706b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:30.635834 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4106e5be-bda3-4c41-b1b9-e171d9c7706b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:30.636572 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4106e5be-bda3-4c41-b1b9-e171d9c7706b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:30.637028 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4106e5be-bda3-4c41-b1b9-e171d9c7706b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:30.637454 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-4106e5be-bda3-4c41-b1b9-e171d9c7706b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:30.771071 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-4106e5be-bda3-4c41-b1b9-e171d9c7706b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:38:30.778764 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-4106e5be-bda3-4c41-b1b9-e171d9c7706b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1265 microversion: 2.1 time: 0.155437 Aug 05 02:38:30.779330 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 641/1281] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:38:30 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:38:31.799574 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c276f1a4-ae93-4b07-963c-188e706fc4bc tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:38:31.800193 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c276f1a4-ae93-4b07-963c-188e706fc4bc tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:38:31.807569 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c276f1a4-ae93-4b07-963c-188e706fc4bc tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:31.808049 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c276f1a4-ae93-4b07-963c-188e706fc4bc tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:31.808519 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c276f1a4-ae93-4b07-963c-188e706fc4bc tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:31.809207 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c276f1a4-ae93-4b07-963c-188e706fc4bc tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:31.809658 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c276f1a4-ae93-4b07-963c-188e706fc4bc tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:31.810083 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c276f1a4-ae93-4b07-963c-188e706fc4bc tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:31.941413 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c276f1a4-ae93-4b07-963c-188e706fc4bc tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:38:31.949400 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c276f1a4-ae93-4b07-963c-188e706fc4bc tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1265 microversion: 2.1 time: 0.153694 Aug 05 02:38:31.949959 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 641/1282] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:38:31 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:38:32.969916 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ee84a400-d182-40ef-ba31-1ac52341ca55 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:38:32.970567 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ee84a400-d182-40ef-ba31-1ac52341ca55 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:38:32.976977 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee84a400-d182-40ef-ba31-1ac52341ca55 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:32.977471 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee84a400-d182-40ef-ba31-1ac52341ca55 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:32.977895 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee84a400-d182-40ef-ba31-1ac52341ca55 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:32.978571 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee84a400-d182-40ef-ba31-1ac52341ca55 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:32.979016 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee84a400-d182-40ef-ba31-1ac52341ca55 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:32.979430 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ee84a400-d182-40ef-ba31-1ac52341ca55 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:33.111652 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ee84a400-d182-40ef-ba31-1ac52341ca55 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:38:33.118992 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ee84a400-d182-40ef-ba31-1ac52341ca55 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1265 microversion: 2.1 time: 0.152932 Aug 05 02:38:33.119547 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 642/1283] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:38:32 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:38:34.139211 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a2d3de2f-0989-48fd-a22e-c00b6236d311 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:38:34.139778 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a2d3de2f-0989-48fd-a22e-c00b6236d311 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:38:34.146197 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2d3de2f-0989-48fd-a22e-c00b6236d311 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:34.146679 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2d3de2f-0989-48fd-a22e-c00b6236d311 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:34.147128 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2d3de2f-0989-48fd-a22e-c00b6236d311 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:34.147809 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2d3de2f-0989-48fd-a22e-c00b6236d311 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:34.148779 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2d3de2f-0989-48fd-a22e-c00b6236d311 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:34.149206 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a2d3de2f-0989-48fd-a22e-c00b6236d311 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:34.282011 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a2d3de2f-0989-48fd-a22e-c00b6236d311 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:38:34.290066 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a2d3de2f-0989-48fd-a22e-c00b6236d311 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1265 microversion: 2.1 time: 0.154843 Aug 05 02:38:34.290616 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 642/1284] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:38:34 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:38:35.310925 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-78cebeed-3bcb-408c-b1a8-aae324e9425b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:38:35.311540 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-78cebeed-3bcb-408c-b1a8-aae324e9425b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:38:35.317842 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78cebeed-3bcb-408c-b1a8-aae324e9425b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:35.318323 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78cebeed-3bcb-408c-b1a8-aae324e9425b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:35.318759 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78cebeed-3bcb-408c-b1a8-aae324e9425b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:35.319446 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78cebeed-3bcb-408c-b1a8-aae324e9425b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:35.319900 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78cebeed-3bcb-408c-b1a8-aae324e9425b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:35.320345 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-78cebeed-3bcb-408c-b1a8-aae324e9425b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:35.451938 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-78cebeed-3bcb-408c-b1a8-aae324e9425b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:38:35.459579 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-78cebeed-3bcb-408c-b1a8-aae324e9425b tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1265 microversion: 2.1 time: 0.152262 Aug 05 02:38:35.460135 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 643/1285] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:38:35 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:38:36.480777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-68919497-7091-4196-ac01-8255d5f9800e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:38:36.481384 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-68919497-7091-4196-ac01-8255d5f9800e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:38:36.483440 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:38:36.488735 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68919497-7091-4196-ac01-8255d5f9800e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:36.489207 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68919497-7091-4196-ac01-8255d5f9800e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:36.489637 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68919497-7091-4196-ac01-8255d5f9800e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:36.490344 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68919497-7091-4196-ac01-8255d5f9800e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:36.490790 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68919497-7091-4196-ac01-8255d5f9800e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:36.491207 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-68919497-7091-4196-ac01-8255d5f9800e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:36.621616 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-68919497-7091-4196-ac01-8255d5f9800e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:38:36.629213 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-68919497-7091-4196-ac01-8255d5f9800e tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1265 microversion: 2.1 time: 0.152887 Aug 05 02:38:36.629776 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 643/1286] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:38:36 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:38:37.650542 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-2cc5385a-4e01-4901-bd50-2e1565dfa580 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:38:37.652125 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-2cc5385a-4e01-4901-bd50-2e1565dfa580 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:38:37.654274 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=2 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:38:37.655136 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell0:SELECT=6 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:38:37.660924 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2cc5385a-4e01-4901-bd50-2e1565dfa580 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:37.661392 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2cc5385a-4e01-4901-bd50-2e1565dfa580 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:37.661824 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2cc5385a-4e01-4901-bd50-2e1565dfa580 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:37.662506 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2cc5385a-4e01-4901-bd50-2e1565dfa580 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:37.662952 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2cc5385a-4e01-4901-bd50-2e1565dfa580 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:37.663373 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-2cc5385a-4e01-4901-bd50-2e1565dfa580 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:37.795137 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-2cc5385a-4e01-4901-bd50-2e1565dfa580 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:38:37.802484 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-2cc5385a-4e01-4901-bd50-2e1565dfa580 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1265 microversion: 2.1 time: 0.156113 Aug 05 02:38:37.803040 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 644/1287] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:38:37 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:38:38.823653 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3073098c-6d87-4331-b66f-46b6d0d45201 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:38:38.824208 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3073098c-6d87-4331-b66f-46b6d0d45201 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:38:38.831466 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3073098c-6d87-4331-b66f-46b6d0d45201 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:38.831951 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3073098c-6d87-4331-b66f-46b6d0d45201 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:38.832403 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3073098c-6d87-4331-b66f-46b6d0d45201 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:38.833101 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3073098c-6d87-4331-b66f-46b6d0d45201 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:38.833974 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3073098c-6d87-4331-b66f-46b6d0d45201 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:38.833974 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3073098c-6d87-4331-b66f-46b6d0d45201 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:38.965666 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3073098c-6d87-4331-b66f-46b6d0d45201 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:38:38.973322 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3073098c-6d87-4331-b66f-46b6d0d45201 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1265 microversion: 2.1 time: 0.153633 Aug 05 02:38:38.973896 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 644/1288] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:38:38 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:38:39.161551 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-3253568a-3d12-457c-9d41-d3963cef864c req-c4d1d01c-6077-4eb0-8be1-c08acfb8a52c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba8009e-b081-467c-8a38-635518673040", "name": "network-vif-plugged", "status": "completed", "tag": "e05f53bc-41a1-41e4-be5a-a9e6158720cd"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:38:39.173188 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-3253568a-3d12-457c-9d41-d3963cef864c req-c4d1d01c-6077-4eb0-8be1-c08acfb8a52c service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:39.173661 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-3253568a-3d12-457c-9d41-d3963cef864c req-c4d1d01c-6077-4eb0-8be1-c08acfb8a52c service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:39.174087 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-3253568a-3d12-457c-9d41-d3963cef864c req-c4d1d01c-6077-4eb0-8be1-c08acfb8a52c service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:39.185686 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-3253568a-3d12-457c-9d41-d3963cef864c req-c4d1d01c-6077-4eb0-8be1-c08acfb8a52c service nova] Creating event network-vif-plugged:e05f53bc-41a1-41e4-be5a-a9e6158720cd for instance 8ba8009e-b081-467c-8a38-635518673040 on hv-cinder-81558 Aug 05 02:38:39.190793 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-3253568a-3d12-457c-9d41-d3963cef864c req-c4d1d01c-6077-4eb0-8be1-c08acfb8a52c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145510 Aug 05 02:38:39.191713 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 645/1289] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:38:39.994574 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-712388ea-e710-4432-af2d-72fff144aa7f tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:38:39.995218 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-712388ea-e710-4432-af2d-72fff144aa7f tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:38:40.001652 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-712388ea-e710-4432-af2d-72fff144aa7f tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:40.002132 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-712388ea-e710-4432-af2d-72fff144aa7f tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:40.002565 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-712388ea-e710-4432-af2d-72fff144aa7f tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:40.003253 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-712388ea-e710-4432-af2d-72fff144aa7f tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:40.003705 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-712388ea-e710-4432-af2d-72fff144aa7f tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:40.004130 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-712388ea-e710-4432-af2d-72fff144aa7f tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:40.137371 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-712388ea-e710-4432-af2d-72fff144aa7f tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:38:40.144863 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-712388ea-e710-4432-af2d-72fff144aa7f tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1265 microversion: 2.1 time: 0.154363 Aug 05 02:38:40.145435 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 645/1290] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:38:39 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:38:41.166742 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-c6d2cf1d-cef0-4f4c-9ac6-42b24381e294 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:38:41.167360 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-c6d2cf1d-cef0-4f4c-9ac6-42b24381e294 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:38:41.173934 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6d2cf1d-cef0-4f4c-9ac6-42b24381e294 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:41.174412 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6d2cf1d-cef0-4f4c-9ac6-42b24381e294 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:41.174850 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6d2cf1d-cef0-4f4c-9ac6-42b24381e294 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:41.175535 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6d2cf1d-cef0-4f4c-9ac6-42b24381e294 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:41.175991 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6d2cf1d-cef0-4f4c-9ac6-42b24381e294 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:41.176446 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-c6d2cf1d-cef0-4f4c-9ac6-42b24381e294 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:41.305706 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-c6d2cf1d-cef0-4f4c-9ac6-42b24381e294 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:38:41.313487 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-c6d2cf1d-cef0-4f4c-9ac6-42b24381e294 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1453 microversion: 2.1 time: 0.151268 Aug 05 02:38:41.314214 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 646/1291] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:38:41 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:38:41.334672 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bc8a8d04-3e37-4ed1-af2b-8bf94e845881 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:38:41.335284 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bc8a8d04-3e37-4ed1-af2b-8bf94e845881 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:38:41.342455 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc8a8d04-3e37-4ed1-af2b-8bf94e845881 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:41.343167 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc8a8d04-3e37-4ed1-af2b-8bf94e845881 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:41.343601 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc8a8d04-3e37-4ed1-af2b-8bf94e845881 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:41.344286 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc8a8d04-3e37-4ed1-af2b-8bf94e845881 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:41.344766 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc8a8d04-3e37-4ed1-af2b-8bf94e845881 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:41.345192 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc8a8d04-3e37-4ed1-af2b-8bf94e845881 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:41.473852 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bc8a8d04-3e37-4ed1-af2b-8bf94e845881 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:38:41.481418 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bc8a8d04-3e37-4ed1-af2b-8bf94e845881 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1453 microversion: 2.1 time: 0.150873 Aug 05 02:38:41.481978 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 646/1292] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:38:41 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:38:43.417905 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-73633756-4ae9-449d-ba0f-bcca0a4a358c req-31d07461-5a6d-4568-8007-e33165b5e0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba8009e-b081-467c-8a38-635518673040", "tag": "e05f53bc-41a1-41e4-be5a-a9e6158720cd"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:38:43.427207 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-73633756-4ae9-449d-ba0f-bcca0a4a358c req-31d07461-5a6d-4568-8007-e33165b5e0e7 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:38:43.427688 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-73633756-4ae9-449d-ba0f-bcca0a4a358c req-31d07461-5a6d-4568-8007-e33165b5e0e7 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:38:43.428116 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-73633756-4ae9-449d-ba0f-bcca0a4a358c req-31d07461-5a6d-4568-8007-e33165b5e0e7 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:38:43.441789 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-73633756-4ae9-449d-ba0f-bcca0a4a358c req-31d07461-5a6d-4568-8007-e33165b5e0e7 service nova] Creating event network-changed:e05f53bc-41a1-41e4-be5a-a9e6158720cd for instance 8ba8009e-b081-467c-8a38-635518673040 on hv-cinder-81558 Aug 05 02:38:43.446734 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-73633756-4ae9-449d-ba0f-bcca0a4a358c req-31d07461-5a6d-4568-8007-e33165b5e0e7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087146 Aug 05 02:38:43.447317 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 647/1293] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:38:46.190616 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:38:46.191145 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Fri Aug 5 02:38:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:38:56.505833 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:38:56.506650 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Fri Aug 5 02:38:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:39:17.790682 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:39:17.791390 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Fri Aug 5 02:39:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:40:28.952442 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:40:28.952977 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Fri Aug 5 02:40:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:40:32.609245 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=20 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:32.609993 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=48 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:32.611833 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:32.612757 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG dbcounter [-] [117921] Writing DB stats nova_cell1:SELECT=44 {{(pid=117921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:32.614816 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5a71386b-e175-4467-828c-8a1eb06300c6 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:40:32.615390 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5a71386b-e175-4467-828c-8a1eb06300c6 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:40:32.618397 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-829eb789-9dde-4e88-ac79-1becaef3edf6 req-dac61faa-cd80-4618-ae4e-8aec74298ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba8009e-b081-467c-8a38-635518673040", "tag": "e05f53bc-41a1-41e4-be5a-a9e6158720cd"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:40:32.627532 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a71386b-e175-4467-828c-8a1eb06300c6 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:32.628032 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a71386b-e175-4467-828c-8a1eb06300c6 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:32.628155 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-829eb789-9dde-4e88-ac79-1becaef3edf6 req-dac61faa-cd80-4618-ae4e-8aec74298ea5 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:32.628498 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a71386b-e175-4467-828c-8a1eb06300c6 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:32.628720 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-829eb789-9dde-4e88-ac79-1becaef3edf6 req-dac61faa-cd80-4618-ae4e-8aec74298ea5 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:32.629176 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-829eb789-9dde-4e88-ac79-1becaef3edf6 req-dac61faa-cd80-4618-ae4e-8aec74298ea5 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:32.629293 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a71386b-e175-4467-828c-8a1eb06300c6 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:32.629637 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a71386b-e175-4467-828c-8a1eb06300c6 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:32.630061 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a71386b-e175-4467-828c-8a1eb06300c6 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:32.643154 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-829eb789-9dde-4e88-ac79-1becaef3edf6 req-dac61faa-cd80-4618-ae4e-8aec74298ea5 service nova] Creating event network-changed:e05f53bc-41a1-41e4-be5a-a9e6158720cd for instance 8ba8009e-b081-467c-8a38-635518673040 on hv-cinder-81558 Aug 05 02:40:32.649182 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-829eb789-9dde-4e88-ac79-1becaef3edf6 req-dac61faa-cd80-4618-ae4e-8aec74298ea5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038982 Aug 05 02:40:32.649657 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 648/1294] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:40:32.658429 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5a71386b-e175-4467-828c-8a1eb06300c6 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:40:32.745445 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5a71386b-e175-4467-828c-8a1eb06300c6 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 204 len: 0 microversion: 2.1 time: 0.137587 Aug 05 02:40:32.746762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 647/1295] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:40:32 2022] DELETE /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:40:32.758920 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-ea27279f-e737-4436-979e-6c37e9f6afa0 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:40:32.760072 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-ea27279f-e737-4436-979e-6c37e9f6afa0 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:40:32.767337 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea27279f-e737-4436-979e-6c37e9f6afa0 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:32.767828 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea27279f-e737-4436-979e-6c37e9f6afa0 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:32.768370 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea27279f-e737-4436-979e-6c37e9f6afa0 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:32.769147 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea27279f-e737-4436-979e-6c37e9f6afa0 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:32.769606 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea27279f-e737-4436-979e-6c37e9f6afa0 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:32.770029 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-ea27279f-e737-4436-979e-6c37e9f6afa0 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:32.906134 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-ea27279f-e737-4436-979e-6c37e9f6afa0 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:40:32.913736 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-ea27279f-e737-4436-979e-6c37e9f6afa0 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1577 microversion: 2.1 time: 0.160203 Aug 05 02:40:32.914939 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 649/1296] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:40:32 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:40:33.935738 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-527bcc4c-1b55-444a-a335-7dfd5f0ae975 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:40:33.936482 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-527bcc4c-1b55-444a-a335-7dfd5f0ae975 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:40:33.943062 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-527bcc4c-1b55-444a-a335-7dfd5f0ae975 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:33.943538 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-527bcc4c-1b55-444a-a335-7dfd5f0ae975 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:33.943968 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-527bcc4c-1b55-444a-a335-7dfd5f0ae975 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:33.944686 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-527bcc4c-1b55-444a-a335-7dfd5f0ae975 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:33.945151 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-527bcc4c-1b55-444a-a335-7dfd5f0ae975 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:33.945605 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-527bcc4c-1b55-444a-a335-7dfd5f0ae975 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:34.078132 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-527bcc4c-1b55-444a-a335-7dfd5f0ae975 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:40:34.086667 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-527bcc4c-1b55-444a-a335-7dfd5f0ae975 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1577 microversion: 2.1 time: 0.154423 Aug 05 02:40:34.087261 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 648/1297] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:40:33 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:40:35.108253 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-8ec83ba9-8dbc-41d0-947e-77b4a722c41a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:40:35.108907 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-8ec83ba9-8dbc-41d0-947e-77b4a722c41a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:40:35.115494 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ec83ba9-8dbc-41d0-947e-77b4a722c41a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:35.115850 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ec83ba9-8dbc-41d0-947e-77b4a722c41a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:35.116276 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ec83ba9-8dbc-41d0-947e-77b4a722c41a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:35.117619 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ec83ba9-8dbc-41d0-947e-77b4a722c41a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:35.118433 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ec83ba9-8dbc-41d0-947e-77b4a722c41a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:35.118837 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-8ec83ba9-8dbc-41d0-947e-77b4a722c41a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:35.125523 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-52637c7c-9ca1-4a64-82d1-c8153cd5b450 req-7ce7725f-b8b6-4889-b057-7e47918076fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba8009e-b081-467c-8a38-635518673040", "name": "network-vif-deleted", "tag": "e05f53bc-41a1-41e4-be5a-a9e6158720cd"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:40:35.135985 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-52637c7c-9ca1-4a64-82d1-c8153cd5b450 req-7ce7725f-b8b6-4889-b057-7e47918076fb service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:35.136493 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-52637c7c-9ca1-4a64-82d1-c8153cd5b450 req-7ce7725f-b8b6-4889-b057-7e47918076fb service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:35.136928 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-52637c7c-9ca1-4a64-82d1-c8153cd5b450 req-7ce7725f-b8b6-4889-b057-7e47918076fb service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:35.148264 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-52637c7c-9ca1-4a64-82d1-c8153cd5b450 req-7ce7725f-b8b6-4889-b057-7e47918076fb service nova] Creating event network-vif-deleted:e05f53bc-41a1-41e4-be5a-a9e6158720cd for instance 8ba8009e-b081-467c-8a38-635518673040 on hv-cinder-81558 Aug 05 02:40:35.156725 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-52637c7c-9ca1-4a64-82d1-c8153cd5b450 req-7ce7725f-b8b6-4889-b057-7e47918076fb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034724 Aug 05 02:40:35.157552 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 649/1298] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:40:35.182455 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-8ec83ba9-8dbc-41d0-947e-77b4a722c41a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:40:35.189927 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-8ec83ba9-8dbc-41d0-947e-77b4a722c41a tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 200 len: 1392 microversion: 2.1 time: 0.085712 Aug 05 02:40:35.190487 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 650/1299] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:40:35 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 1392 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:40:36.214140 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-58c7c808-0e81-4343-9170-f73c0188cfa1 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:40:36.214833 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-58c7c808-0e81-4343-9170-f73c0188cfa1 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 8ba8009e-b081-467c-8a38-635518673040] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:40:36.220844 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58c7c808-0e81-4343-9170-f73c0188cfa1 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:36.221324 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58c7c808-0e81-4343-9170-f73c0188cfa1 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:36.221759 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58c7c808-0e81-4343-9170-f73c0188cfa1 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:36.222441 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58c7c808-0e81-4343-9170-f73c0188cfa1 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:36.222893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58c7c808-0e81-4343-9170-f73c0188cfa1 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:36.223312 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58c7c808-0e81-4343-9170-f73c0188cfa1 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:36.237694 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-58c7c808-0e81-4343-9170-f73c0188cfa1 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] HTTP exception thrown: Instance 8ba8009e-b081-467c-8a38-635518673040 could not be found. Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-58c7c808-0e81-4343-9170-f73c0188cfa1 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Request method failure captured: Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 HTTP/1.1 Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7IFXsRyRlyF18YEmzIIFPaB-Cy7lmBdWPjbtt4vbuRTZg5uYrlxk3bFcEAU1sNHf8qNgAFAHwTgW75cUpBr1mLHWLCvgso3vRc8WmVuk0PDSsP7OOB_J1Ae9HKPa7qIULXFC6czMO3Ar4swOQNlOFqeuI7mE_k1s8fG9FkPaLLZa1HY Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 59a7ad5acdc34d0782e2c6807a4fd60f Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestVolumeBootPattern-1870709547 Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:40:36.239290 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:40:36.241217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/59a7ad5acdc34d0782e2c6807a4fd60f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_59a7ad5acdc34d0782e2c6807a4fd60f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59a7ad5acdc34d0782e2c6807a4fd60f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59a7ad5acdc34d0782e2c6807a4fd60f"}]}] Aug 05 02:40:36.241217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestVolumeBootPattern-1870709547 Aug 05 02:40:36.241217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 59a7ad5acdc34d0782e2c6807a4fd60f Aug 05 02:40:36.241217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870709547 Aug 05 02:40:36.241217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-TestVolumeBootPattern-1870709547-project Aug 05 02:40:36.241217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:40:36.241217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:40:36.241217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 5f163bd8d55e47019d7e7ef5ade78b38 Aug 05 02:40:36.241217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestVolumeBootPattern-1870709547-project Aug 05 02:40:36.241217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:40:36.241217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 8ba8009e-b081-467c-8a38-635518673040 could not be found. Aug 05 02:40:36.241217 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '8ba8009e-b081-467c-8a38-635518673040'} Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba8009e-b081-467c-8a38-635518673040 could not be found. Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:40:36.242215 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba8009e-b081-467c-8a38-635518673040 could not be found. Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba8009e-b081-467c-8a38-635518673040 could not be found. Aug 05 02:40:36.244045 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:40:36.245826 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-58c7c808-0e81-4343-9170-f73c0188cfa1 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Returning 404 to user: Instance 8ba8009e-b081-467c-8a38-635518673040 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:40:36.245826 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-58c7c808-0e81-4343-9170-f73c0188cfa1 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040" status: 404 len: 111 microversion: 2.1 time: 0.031860 Aug 05 02:40:36.245826 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 650/1300] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:40:36 2022] GET /compute/v2.1/servers/8ba8009e-b081-467c-8a38-635518673040 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:40:38.822243 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:40:38.822243 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Fri Aug 5 02:40:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:40:39.547739 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-9acfa311-e84e-4e3e-a5df-23d2d6bfff28 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:40:39.548233 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9acfa311-e84e-4e3e-a5df-23d2d6bfff28 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:40:39.551065 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-4a5151c6-9ec1-47a2-a015-16202973370e req-3aed8242-fdd5-4eb2-a1a6-46e6c1e9b023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "448fb5f6-7616-4be3-bd7c-2851aca8c865", "tag": "a3416a42-520d-4b05-a1b9-2f9d757bc127"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:40:39.554480 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9acfa311-e84e-4e3e-a5df-23d2d6bfff28 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:39.554966 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9acfa311-e84e-4e3e-a5df-23d2d6bfff28 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:39.555398 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9acfa311-e84e-4e3e-a5df-23d2d6bfff28 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:39.556093 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9acfa311-e84e-4e3e-a5df-23d2d6bfff28 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:39.556579 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9acfa311-e84e-4e3e-a5df-23d2d6bfff28 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:39.557000 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-9acfa311-e84e-4e3e-a5df-23d2d6bfff28 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:39.564520 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4a5151c6-9ec1-47a2-a015-16202973370e req-3aed8242-fdd5-4eb2-a1a6-46e6c1e9b023 service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:39.565070 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4a5151c6-9ec1-47a2-a015-16202973370e req-3aed8242-fdd5-4eb2-a1a6-46e6c1e9b023 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:39.565716 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-4a5151c6-9ec1-47a2-a015-16202973370e req-3aed8242-fdd5-4eb2-a1a6-46e6c1e9b023 service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:39.578894 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-4a5151c6-9ec1-47a2-a015-16202973370e req-3aed8242-fdd5-4eb2-a1a6-46e6c1e9b023 service nova] Creating event network-changed:a3416a42-520d-4b05-a1b9-2f9d757bc127 for instance 448fb5f6-7616-4be3-bd7c-2851aca8c865 on hv-cinder-81558 Aug 05 02:40:39.583455 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-9acfa311-e84e-4e3e-a5df-23d2d6bfff28 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Going to try to terminate instance {{(pid=117921) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 05 02:40:39.584431 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-4a5151c6-9ec1-47a2-a015-16202973370e req-3aed8242-fdd5-4eb2-a1a6-46e6c1e9b023 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037167 Aug 05 02:40:39.586116 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 651/1301] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 05 02:40:39.669553 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-9acfa311-e84e-4e3e-a5df-23d2d6bfff28 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "DELETE /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 204 len: 0 microversion: 2.1 time: 0.124189 Aug 05 02:40:39.673684 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 651/1302] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:40:39 2022] DELETE /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 05 02:40:39.678603 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-51c4db2e-8e97-4191-855b-7efaf1dd2f58 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:40:39.679612 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-51c4db2e-8e97-4191-855b-7efaf1dd2f58 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:40:39.685782 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51c4db2e-8e97-4191-855b-7efaf1dd2f58 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:39.686589 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51c4db2e-8e97-4191-855b-7efaf1dd2f58 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:39.687191 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51c4db2e-8e97-4191-855b-7efaf1dd2f58 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:39.688056 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51c4db2e-8e97-4191-855b-7efaf1dd2f58 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:39.688817 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51c4db2e-8e97-4191-855b-7efaf1dd2f58 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:39.689399 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51c4db2e-8e97-4191-855b-7efaf1dd2f58 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:39.825777 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-51c4db2e-8e97-4191-855b-7efaf1dd2f58 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:40:39.833697 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-51c4db2e-8e97-4191-855b-7efaf1dd2f58 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1574 microversion: 2.1 time: 0.159340 Aug 05 02:40:39.834476 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 652/1303] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:40:39 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:40:40.856248 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-91f3d6bb-80f0-4fbf-8349-c7b8fab2f135 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:40:40.856964 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-91f3d6bb-80f0-4fbf-8349-c7b8fab2f135 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:40:40.863366 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-91f3d6bb-80f0-4fbf-8349-c7b8fab2f135 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:40.863843 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-91f3d6bb-80f0-4fbf-8349-c7b8fab2f135 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:40.864268 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-91f3d6bb-80f0-4fbf-8349-c7b8fab2f135 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:40.864983 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-91f3d6bb-80f0-4fbf-8349-c7b8fab2f135 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:40.865426 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-91f3d6bb-80f0-4fbf-8349-c7b8fab2f135 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:40.865841 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-91f3d6bb-80f0-4fbf-8349-c7b8fab2f135 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:41.018050 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.policy [None req-91f3d6bb-80f0-4fbf-8349-c7b8fab2f135 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117921) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:40:41.025740 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-91f3d6bb-80f0-4fbf-8349-c7b8fab2f135 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1574 microversion: 2.1 time: 0.173656 Aug 05 02:40:41.026318 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 652/1304] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:40:40 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:40:42.047910 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e4bb7a6d-e03d-40df-8971-1679fdcca957 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:40:42.048557 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e4bb7a6d-e03d-40df-8971-1679fdcca957 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:40:42.055574 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4bb7a6d-e03d-40df-8971-1679fdcca957 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:42.056054 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4bb7a6d-e03d-40df-8971-1679fdcca957 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:42.056516 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4bb7a6d-e03d-40df-8971-1679fdcca957 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:42.057213 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4bb7a6d-e03d-40df-8971-1679fdcca957 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:42.057671 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4bb7a6d-e03d-40df-8971-1679fdcca957 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:42.058096 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4bb7a6d-e03d-40df-8971-1679fdcca957 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:42.125626 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e4bb7a6d-e03d-40df-8971-1679fdcca957 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f163bd8d55e47019d7e7ef5ade78b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a7ad5acdc34d0782e2c6807a4fd60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Aug 05 02:40:42.135727 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e4bb7a6d-e03d-40df-8971-1679fdcca957 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 200 len: 1390 microversion: 2.1 time: 0.091831 Aug 05 02:40:42.136484 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 653/1305] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:40:42 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 1390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 05 02:40:42.138850 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [req-ec07431c-48e5-471b-9721-68c2f282eb8e req-2b0d774d-bcde-44b8-8812-53b7f23cdd8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448fb5f6-7616-4be3-bd7c-2851aca8c865", "name": "network-vif-deleted", "tag": "a3416a42-520d-4b05-a1b9-2f9d757bc127"}]} {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 05 02:40:42.151341 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-ec07431c-48e5-471b-9721-68c2f282eb8e req-2b0d774d-bcde-44b8-8812-53b7f23cdd8d service nova] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:42.152068 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-ec07431c-48e5-471b-9721-68c2f282eb8e req-2b0d774d-bcde-44b8-8812-53b7f23cdd8d service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:42.152562 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [req-ec07431c-48e5-471b-9721-68c2f282eb8e req-2b0d774d-bcde-44b8-8812-53b7f23cdd8d service nova] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:42.165076 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.compute.server_external_events [req-ec07431c-48e5-471b-9721-68c2f282eb8e req-2b0d774d-bcde-44b8-8812-53b7f23cdd8d service nova] Creating event network-vif-deleted:a3416a42-520d-4b05-a1b9-2f9d757bc127 for instance 448fb5f6-7616-4be3-bd7c-2851aca8c865 on hv-cinder-81558 Aug 05 02:40:42.170471 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [req-ec07431c-48e5-471b-9721-68c2f282eb8e req-2b0d774d-bcde-44b8-8812-53b7f23cdd8d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035534 Aug 05 02:40:42.171091 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 653/1306] 10.222.0.15 () {64 vars in 1317 bytes} [Fri Aug 5 02:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 05 02:40:43.159131 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b708414d-0e91-4436-8943-f5db29ec6f0c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:40:43.159699 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b708414d-0e91-4436-8943-f5db29ec6f0c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 448fb5f6-7616-4be3-bd7c-2851aca8c865] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:40:43.167317 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b708414d-0e91-4436-8943-f5db29ec6f0c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:43.167798 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b708414d-0e91-4436-8943-f5db29ec6f0c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:43.168236 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b708414d-0e91-4436-8943-f5db29ec6f0c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:43.168950 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b708414d-0e91-4436-8943-f5db29ec6f0c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:43.169403 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b708414d-0e91-4436-8943-f5db29ec6f0c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:43.169827 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b708414d-0e91-4436-8943-f5db29ec6f0c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:43.183266 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-b708414d-0e91-4436-8943-f5db29ec6f0c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] HTTP exception thrown: Instance 448fb5f6-7616-4be3-bd7c-2851aca8c865 could not be found. Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b708414d-0e91-4436-8943-f5db29ec6f0c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Request method failure captured: Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 HTTP/1.1 Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7IFXsRyRlyF18YEmzIIFPaB-Cy7lmBdWPjbtt4vbuRTZg5uYrlxk3bFcEAU1sNHf8qNgAFAHwTgW75cUpBr1mLHWLCvgso3vRc8WmVuk0PDSsP7OOB_J1Ae9HKPa7qIULXFC6czMO3Ar4swOQNlOFqeuI7mE_k1s8fG9FkPaLLZa1HY Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 59a7ad5acdc34d0782e2c6807a4fd60f Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestVolumeBootPattern-1870709547 Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:40:43.184893 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:40:43.186654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/59a7ad5acdc34d0782e2c6807a4fd60f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_59a7ad5acdc34d0782e2c6807a4fd60f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59a7ad5acdc34d0782e2c6807a4fd60f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59a7ad5acdc34d0782e2c6807a4fd60f"}]}] Aug 05 02:40:43.186654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestVolumeBootPattern-1870709547 Aug 05 02:40:43.186654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 59a7ad5acdc34d0782e2c6807a4fd60f Aug 05 02:40:43.186654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870709547 Aug 05 02:40:43.186654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-TestVolumeBootPattern-1870709547-project Aug 05 02:40:43.186654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:40:43.186654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:40:43.186654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 5f163bd8d55e47019d7e7ef5ade78b38 Aug 05 02:40:43.186654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestVolumeBootPattern-1870709547-project Aug 05 02:40:43.186654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:40:43.186654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 448fb5f6-7616-4be3-bd7c-2851aca8c865 could not be found. Aug 05 02:40:43.186654 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '448fb5f6-7616-4be3-bd7c-2851aca8c865'} Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448fb5f6-7616-4be3-bd7c-2851aca8c865 could not be found. Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:40:43.187762 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448fb5f6-7616-4be3-bd7c-2851aca8c865 could not be found. Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448fb5f6-7616-4be3-bd7c-2851aca8c865 could not be found. Aug 05 02:40:43.189597 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:40:43.191326 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b708414d-0e91-4436-8943-f5db29ec6f0c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Returning 404 to user: Instance 448fb5f6-7616-4be3-bd7c-2851aca8c865 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:40:43.191326 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b708414d-0e91-4436-8943-f5db29ec6f0c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865" status: 404 len: 111 microversion: 2.1 time: 0.031133 Aug 05 02:40:43.191326 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 654/1307] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:40:43 2022] GET /compute/v2.1/servers/448fb5f6-7616-4be3-bd7c-2851aca8c865 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:40:43.638543 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-066a598b-c903-434b-875e-28e2cdfa62e9 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:40:43.639152 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.compute.api [None req-066a598b-c903-434b-875e-28e2cdfa62e9 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117921) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:40:43.645361 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-066a598b-c903-434b-875e-28e2cdfa62e9 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:43.645843 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-066a598b-c903-434b-875e-28e2cdfa62e9 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:43.646277 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-066a598b-c903-434b-875e-28e2cdfa62e9 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:43.646960 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-066a598b-c903-434b-875e-28e2cdfa62e9 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:43.647411 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-066a598b-c903-434b-875e-28e2cdfa62e9 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:43.648475 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG oslo_concurrency.lockutils [None req-066a598b-c903-434b-875e-28e2cdfa62e9 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117921) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:43.664533 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.wsgi [None req-066a598b-c903-434b-875e-28e2cdfa62e9 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] HTTP exception thrown: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-066a598b-c903-434b-875e-28e2cdfa62e9 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Request method failure captured: Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: request: DELETE /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d HTTP/1.1 Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept: application/json Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Accept-Encoding: identity Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Connection: close Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Length: 0 Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Content-Type: application/json Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Host: 10.222.0.15 Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Openstack-System-Scope: None Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: User-Agent: python-urllib3/1.26.11 Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Auth-Token: gAAAAABi7IFXsRyRlyF18YEmzIIFPaB-Cy7lmBdWPjbtt4vbuRTZg5uYrlxk3bFcEAU1sNHf8qNgAFAHwTgW75cUpBr1mLHWLCvgso3vRc8WmVuk0PDSsP7OOB_J1Ae9HKPa7qIULXFC6czMO3Ar4swOQNlOFqeuI7mE_k1s8fG9FkPaLLZa1HY Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Id: None Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Domain-Name: None Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Identity-Status: Confirmed Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Is-Admin-Project: True Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Id: default Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Domain-Name: Default Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Id: 59a7ad5acdc34d0782e2c6807a4fd60f Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Project-Name: tempest-TestVolumeBootPattern-1870709547 Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Role: reader,member Aug 05 02:40:43.666158 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Roles: reader,member Aug 05 02:40:43.667873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/59a7ad5acdc34d0782e2c6807a4fd60f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_59a7ad5acdc34d0782e2c6807a4fd60f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59a7ad5acdc34d0782e2c6807a4fd60f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59a7ad5acdc34d0782e2c6807a4fd60f"}]}] Aug 05 02:40:43.667873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant: tempest-TestVolumeBootPattern-1870709547 Aug 05 02:40:43.667873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Id: 59a7ad5acdc34d0782e2c6807a4fd60f Aug 05 02:40:43.667873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870709547 Aug 05 02:40:43.667873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User: tempest-TestVolumeBootPattern-1870709547-project Aug 05 02:40:43.667873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Id: default Aug 05 02:40:43.667873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Domain-Name: Default Aug 05 02:40:43.667873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Id: 5f163bd8d55e47019d7e7ef5ade78b38 Aug 05 02:40:43.667873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: X-User-Name: tempest-TestVolumeBootPattern-1870709547-project Aug 05 02:40:43.667873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: method: > Aug 05 02:40:43.667873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: exception: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. Aug 05 02:40:43.667873 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: action_args: {'id': '3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d'} Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:40:43.669017 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. Aug 05 02:40:43.670603 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: ERROR nova.api.openstack.wsgi Aug 05 02:40:43.672357 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-066a598b-c903-434b-875e-28e2cdfa62e9 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Returning 404 to user: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. {{(pid=117921) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:40:43.672357 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-066a598b-c903-434b-875e-28e2cdfa62e9 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 404 len: 111 microversion: 2.1 time: 0.033883 Aug 05 02:40:43.672357 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 654/1308] 10.222.0.15 () {58 vars in 1239 bytes} [Fri Aug 5 02:40:43 2022] DELETE /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:40:43.676230 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f0028f57-82de-4a38-ab6c-2ca8043b0142 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:40:43.676887 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f0028f57-82de-4a38-ab6c-2ca8043b0142 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] [instance: 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 05 02:40:43.682896 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0028f57-82de-4a38-ab6c-2ca8043b0142 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:43.683376 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0028f57-82de-4a38-ab6c-2ca8043b0142 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:43.683812 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0028f57-82de-4a38-ab6c-2ca8043b0142 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:43.684529 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0028f57-82de-4a38-ab6c-2ca8043b0142 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Acquiring lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 05 02:40:43.684983 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0028f57-82de-4a38-ab6c-2ca8043b0142 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 05 02:40:43.685410 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0028f57-82de-4a38-ab6c-2ca8043b0142 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Lock "6a4fb03c-ecbf-4928-85f2-a2fa83e41a91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 05 02:40:43.698710 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-f0028f57-82de-4a38-ab6c-2ca8043b0142 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] HTTP exception thrown: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f0028f57-82de-4a38-ab6c-2ca8043b0142 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Request method failure captured: Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d HTTP/1.1 Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept: application/json Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Connection: close Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Length: 0 Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Content-Type: application/json Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Host: 10.222.0.15 Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.11 Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi7IFXsRyRlyF18YEmzIIFPaB-Cy7lmBdWPjbtt4vbuRTZg5uYrlxk3bFcEAU1sNHf8qNgAFAHwTgW75cUpBr1mLHWLCvgso3vRc8WmVuk0PDSsP7OOB_J1Ae9HKPa7qIULXFC6czMO3Ar4swOQNlOFqeuI7mE_k1s8fG9FkPaLLZa1HY Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Id: 59a7ad5acdc34d0782e2c6807a4fd60f Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestVolumeBootPattern-1870709547 Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Role: reader,member Aug 05 02:40:43.700254 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Aug 05 02:40:43.701973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/59a7ad5acdc34d0782e2c6807a4fd60f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_59a7ad5acdc34d0782e2c6807a4fd60f", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59a7ad5acdc34d0782e2c6807a4fd60f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/59a7ad5acdc34d0782e2c6807a4fd60f"}]}] Aug 05 02:40:43.701973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestVolumeBootPattern-1870709547 Aug 05 02:40:43.701973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 59a7ad5acdc34d0782e2c6807a4fd60f Aug 05 02:40:43.701973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870709547 Aug 05 02:40:43.701973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User: tempest-TestVolumeBootPattern-1870709547-project Aug 05 02:40:43.701973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Aug 05 02:40:43.701973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Aug 05 02:40:43.701973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Id: 5f163bd8d55e47019d7e7ef5ade78b38 Aug 05 02:40:43.701973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestVolumeBootPattern-1870709547-project Aug 05 02:40:43.701973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: method: > Aug 05 02:40:43.701973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: exception: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. Aug 05 02:40:43.701973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: action_args: {'id': '3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d'} Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 05 02:40:43.703157 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. Aug 05 02:40:43.704901 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Aug 05 02:40:43.706411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f0028f57-82de-4a38-ab6c-2ca8043b0142 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Returning 404 to user: Instance 3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 05 02:40:43.706411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f0028f57-82de-4a38-ab6c-2ca8043b0142 tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d" status: 404 len: 111 microversion: 2.1 time: 0.029275 Aug 05 02:40:43.706411 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 655/1309] 10.222.0.15 () {58 vars in 1236 bytes} [Fri Aug 5 02:40:43 2022] GET /compute/v2.1/servers/3c2d2be2-2ffa-443f-9ae4-47a8c41bf46d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 05 02:40:44.997957 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: DEBUG nova.api.openstack.wsgi [None req-1b16c80f-547e-4c35-9a65-d0a3a205280c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] Calling method '.version_select at 0x7fa660db1790>' {{(pid=117921) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 05 02:40:45.026091 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO nova.api.openstack.requestlog [None req-1b16c80f-547e-4c35-9a65-d0a3a205280c tempest-TestVolumeBootPattern-1870709547 tempest-TestVolumeBootPattern-1870709547-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-592323774" status: 202 len: 0 microversion: 2.1 time: 0.032086 Aug 05 02:40:45.026942 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: [pid: 117921|app: 0|req: 655/1310] 10.222.0.15 () {58 vars in 1260 bytes} [Fri Aug 5 02:40:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-592323774 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 05 02:42:06.199401 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:42:06.199988 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Fri Aug 5 02:42:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:42:16.514273 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:42:16.514973 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Fri Aug 5 02:42:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:43:48.961212 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:43:48.961710 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Fri Aug 5 02:43:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:43:58.830293 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:43:58.830923 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Fri Aug 5 02:43:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:45:26.207676 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:45:26.208295 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Fri Aug 5 02:45:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:45:36.522576 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:45:36.523361 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Fri Aug 5 02:45:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:45:57.802227 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:45:57.802900 dv-cinder-815582-13-iscsi devstack@n-api.service[117920]: Fri Aug 5 02:45:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 05 02:45:58.935709 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 05 02:45:58.936236 dv-cinder-815582-13-iscsi devstack@n-api.service[117921]: Fri Aug 5 02:45:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!